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This Volume contains the results of the field 
work axid analysis under this contract. It 
also contains a description of an integrated 
management system which we bolibve provides the 
proper conceptual framework for relating output 
standards to the inputs and other internal ES 
factors. Our findings have lad us to conclude 
that only an integrated approach shouldbe used 
in further develop: ^e^nt of B?P (output) type 
measure and perfor.iance standards (inputs) . 
Chapter one sots stage by dasrribing and 
illustrating the relationship of outputs and 
inputs within the conceptual framevrarJc. Chapters 
tv;o and three press^nt d;5tailed bindings of our 
project. 
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Chapter I 



INTEGRATED MANAGEMENT SYSTEM FOR ES 

Theory of Integrated Management System 

As a result of our investigations of the Balanced 
.Placement Formula and the surveys for developing a 
methodology to establish Performance Standards we 
have concluded that an additional product should be 
developed for integrating these two management tools 
and .several others in a unified system. 

The cornerstone for such a system is a method for 
estimating ES placement potential at the labor area 
levels for setting output performance standards or 
norms, for measuring output pcirformance against the 
standards, and for compiling a summary performance 
score similar to that now computed via the BPP at the 
State level. 

The results of such a methodology would be used in two 
ways. First, for funding allocation purposes, a state 
composite score would be calculated via a weighted 
summation of labor area scores, and the state allo- 
cation of funds would be perf ormance-^adjusted based on 
the state's deviation from its own internal performance 
norms, instead* of a national average. Second^ the 
methodology would identify poor performing areas within 
a fitate^ that need special attention, 

A number of diagnostic tools currently under develop- 
ment and testing could be utilized to identify possible 
causes of poor performance in the labor area. The 
handbook for location of ES local offices could help 
to assess the appropriateness of current locations and 
the need to close, move or open offices. The Handbook 
for Analyzing Local ES Performance , developed under 
this contract, provides tools^ for analyzing local office 
resource utilization, service ratios and key quality 
factors, and the Methodology Guide for Establishing Input 
and Output Standards may lead to specific numeric standards 
for utilization of input resources. The Management Audit 
Survey developed by IBRIC could be used to identify specific 
weaknesses in management practices. 

Each of these tools should be integrated into the existing 
i: L ; ■ ;Mi - ; p-^.'] rrcd "ilrr^*- v;:^h ct-hcr c::irtinc 

tools to identify potential causes of poor performance 
and to develop a corrective action plan, through intelligent 
use of analysis results in light of the real constraints 
and needs of the specific labor area. 



At this level of organisation, management is often 
carried out by a single individual who is required to 
balance the needs of several programs and systems which 
are separately administered at the state and national 
level* Conflicts between separate systems and programs 
Can create severe problems for such Jl.ocal managers. 
When programs and systems have been integrated, thereby 
preventing the ES from being in conflict with itself , 
these local managers work most efficiently. This 
requirement is paxticularly importaiit in the design 
of management systems for raising efficiency, * Only ^ - 
an integrated non-conflict management systf^m can combine / 
the incentives for producing placements, expressed by 
the Balanced Placement Formula, with the diagnostic and 
prescriptive features of the Performance Standards 
Survey Methodology, the Management Audijt System, the 
Self Appraisal System, and POSARS. 

In the integrated iranagement system we are envisioning 
here, these currently separate systems will be organized 
into a unified package of tools focused upon the 
problems and operations of the local manager. Infor- 
mation, derived from ESARS and Cost Accounting, will be 
fed back to the local manager to be used to diagnose 
performance* Based upon a "typology" of the labor area 
in combination with an estimating formula a "potential 
for placement" that applies to the local community will 
be established* This potential sets goals for the 
labor area and establishes a EPF that can be applied 
at that: local level. The BPF score that reflects the 
local operatio;^ indicates whether improvements mar/ be 
possible upon deeper analysis* The Performance 
Stand'irds Survey and the Management Audit 'System are 
management tools that can be brought to bear in analyzing 
such local ES oparaticns with an aim to improving per- 
rormanci?. Tor eKample, the H ardbook fo r An alyzing Local 
IjS Porf c rtriance describes model operations of the place- 
ment rr/3i.em which permit comparisons with actual opera- 
tions. By using this comparisoiv local managers can pin- 
]polnt \ho compononts of the placement process that could 
be i-xij-jroved or modifiv=fcl* 

AH;ressi^g ^utou t Performance 

In the j,ntegrated management system the assessment of 
outpi't performance will be made by comparing actual 
per f crmr:xnce against a potential for placement developed 
tiirough an examination o£ the external factors in the 
local labor area* in Volume 3 (Methodology Guide) 

concept, the labor arer can be typed on the basis of 
a few significant externrO^ variables such as the total 
employment, and then its potential for placement 
estimr.ted by a formula v;hich accounts for addi1:ional 
Gxternal variables* The formula will be developed in 

2 V 



the next major phase of the development of ES performanc 
Standards when data on many labor areas will be analyzed 
result of that development will be an estimating formula 
which yields a value for placements that an '"average" 
labor area of each type would have, given the external 
factors that actually exist in any specific labor 
area. Actual placements achieved by the ES in the 
specific area can then be compared to this '"potential" 
to give a local score {just as the BPF provides a 
State score) . This local "BPF scora" will indicate 
whether improvements may be possible upon deeper analy- 
sis. If such improvements seem possible/ the peeper 
analysis will utilize tools such as the Handbook for 
Analyzing Local ES Performance ^ the survey techniques 
and analysis developed in this project. 

Assessing Input Performance 

Diagnosing the cause for discrepancy between actual 
and potential ES performance, the next step in this 
process, requires an assessment of input performance. 
When the integrated management system has been fully 
developed^ a number of alternative tools for making the 
diagnosis will be available^ we view the Handbook for 
Analyzing Local ES Performance , developed by this 
pro3ect, as this most important alternative. It will 
provide measures on three scales: 

a. Resource allocation and efficiency. 

b. Service percentages reflecting the extent of each 
placement component in the total service delivered 
by the ES. 

c. A check on the key qualitv factors reflecting the 
conformance between the mutual practices compar^sd 
to the generally accepted way to carry out thB 
placement process* 

On each scale tlie actual performance will be compared 
to model measures for offices of the same type. Differ^ 
ences between these two (actual vs. model) will be 
examined to account for differences between potential 
and actual output performance. The validity of the 
model will be based upon the large survey planned for 
the. next step (the establishment of input standards) . 
High-performing labor eureas are expected, in that sur- 
vey, to e::hibiw si.ailar paL'Liorns of rr.oasures and to 
thereby provide the models for the Standards. The 
examples in the next section illustrate the concept of 
this analysis. Two Offices in our survey are compared 
instead of an actual office and a model. (Models cannot 
be developed until the large survey has been completed.) 
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Planning for Improvement 



.To illustrate the form in -which the data can be analyzed 
arid some potential uses of the data^ Table 1 on the 
following page shows the results of applying the niethod- 
ology to two local offices. Part A of the Table shows the 
percent of resources allocated to each category in the 
placement process. The categories were defined by the 
process described above and can be related directly to 
codes used in the official time'distribution system.. 
(The alphabetic codes were developed and used in the data 
collection at the local office le^el to avoid confusion 
between time recording on the survey time ladders and time 
Coding on the time distribution sheets.) 

The local office manager has planning and budgeting stan-* 
dards of comparison for resource utilization and service 
ratios from the Plan of Service System and has data on 
performance per unit of resources from POSARS . Comparing 
the results of the survey with the data from official 
sources I the manager can compare his actual resource util- 
ization and intermediate outputs with his plan, and can 
validate the official figures. He can also review the 
data on key quality factors for each activity against avail- 
able (published or personal) standards of performance and 
identify staff training needs in the state*of-the-art. , 

The area manager or field supervisor given data from 
several local offices, can compare input resource util- 
ization with intermediate and final outputs to identify 
potential areas for correction. In the examples, LO 2 
h€LS a rruch lower number of tnonthly placements per equiv- 
alent staff position than does LO 1. LO 1 devotes 
relatively more resources to employer service arid to file 
•search and call-in, and less to application-taking and 
counseling. It has higher service ratios for referral 
inuerviev;ing/ and a better rating on employer service 
cjuality factors- A field supervisor could use such 
comparative data, even in the abs3nce of validated stan- 
f5:irds^ to e:^amine the causes of such differences, including 
the effects of external ccononic factors, etc., and to 
develop a plan for improving ji^^^ormance in the second 
locc.1 office. 

"rhis exaiaple illustrates the potential for applying such 
methods in the diagnostic process even on an interim 
basis. It also illustrates the potential pitfalls of 

can be develO£^ed in accordance with the methodology and 
plans which will be a part of the end product of this 



Table 1 , Example of Data Coinpilation from On-site Survey 
Of 2 liocal Offices 



A« % Resource Allocation for Placement Process Component 
Activities 







W#-l (ft) 


L0#-2 {%) 


AT 


APPLICATION TAKING 


8.1 


14 . 5 


CS 


com::unity service 




0. fi- 


CO 


COUNSELING 


2.1 


ll. 0 


ES ■ 


EMPLOYER SERVICE 




2, 2 


FC 


PILE SEARCH/CALL- IN 


7,1 


TTiT 


JD 


JOB DEVELOPMENT 


S.T 


TTS 


JIS 


JOB INFORMATION SERVICE 


1.5 


2.1 


JO 


JOB ORDER TAKING 


1»9 


2,7 


RB 


RECEPTION 


4,5 


6.6 


RC 


REFERRAL CONTROL 


4.3 


0,3 


RI 


REFERRAL INTERVJCEWING 


9.8' 


11. 3 


TE 


TESTING 


2,5 


0.1 


VE 


VERIFICATION/VALIDATION 


2.0 


1,3 


Non-Placement Subtotal 


43.2 


41.7 


*XC 


CETA 


0.0 


1,6 




EFS STUDY 


0,5 


1,0 


*XP 


CLERICAL 


11,2 


8o9 




SICK 


4.4 


2.4 




JOB CORPS, FOOD STA.MP, Ul, 


ETC, 1.0 


2.7 




MEETING f TRAINING 


6.6 


0.4 


*xs 


SUPER, r MANAGEMENT, ETC 


6.5 


4.4 




VACATION, ANNUAL LEAVE 


5.8 


5.0 


*xx 


PERSONAL, COFFEE BREAK, ALL 


ELSE 7.2 


11.8 



B, Selected Service Ratios {Percent of -Traffic) 

Application Taking 44,0% 46.9% 

Referral Interviews 60. 5S 51, 9S 



C* Selected Quality Factors: 

% Responding Employers Answering "YES" 
Does an ES representative contact you 

regularly? 75% 43% 

does he/she appear to bo knowledgeable 

of the current labor market? 93% 50% 



Monthly Placements per Equivalent 

Position 45*8% 28*6% 

O ^ ^ 10 

ERIC 



projectr but such sLaadards can never be used in a 
rote cookbook manner to prescribe changes in the 
organization or functioning of the ES* The need for 
such changes must always be identified on the basis 
of sub-'Standard output performance, and corrective 
plans must always take into account the specific 
rGalities and constraints of tne individual latior 
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Chapter II 

FINDINGS FSOM P5;SKA^<"H Ti^TTO THE BAT^ANCEH PLACEMENT FORMULA 
AND IMPLICATIONS FOR OUTPUT STANDARDS FOR 
THE UNITED STATES EMPLOYMENT SERVICE 



A, Inti:oduction . ■ 

The broad objectives of the Employinent service are: (10 to 
provide ser^/ice necessary to assiat job seekers to obtain 
suitable employment, (2) to provide service to employere 
necessary to aid them to obtain qualified workers, (3) to 
provide technical services to employers to facilitate their 
hiring and use o? veterans, disadvantaged j and other vorkers, 
and (4) to provide occupational and Xab<5f^na5}cet information 
to job seekers ^nd eltiployers and to employer, 3>bor, educa- 
tional^ manpower planning and" other organizations and agencies ♦ 
in the community in need of such information, 

. BPF Handbook for FY 1975 , p, 1, 

These broad objectives have existed throughout most of the 
history of the Employment Service (ES) , The Balanced Place- 
ment (BPF) is a perfomance-^based budgetting approach that 
attempts to allocate funds to state ES agencies in an 
' equitable manner, based on the quantity and quality of their 
actual performance with respect to the objectives. First 
introduced in a limited V7ay late in FY 19 73, the BPF was 
expanded and used as the basic method for allocating Title III 
ES grants funds to the states in FY 1975 and, with research- 
based revisions, it is being used in FY 1976, 

Although the concept of performance-based budgeting is 
generally accepted throughout the ES system, the application 
of thG BPF in FY 1975 caused concern among the states^ 
particularly those who lost funds, about the soundness and 
equity of the BPF, The concerns were of three types* First, 
do the performance measures in the BPF adequately measure ES 
performance in relation to the broad objectives^ and does 
the formula contain incentives to improve the quantity and 
quality of performance? Second, can the formula be manipulated 
by individual states to their advantage without improving the 
basic quality or quantity of performance? Third, is the 
formula inequitable in the sense of rewarding or penalizing 
states whose performance is high or low as a result of external 
crr.ncrzc ^?ctorr. that make it easier to provide services in 
some states and harder in others , but over which the ES has 

To help answer these questions and to assist in refining and 
improving the BPF for FY 19 76, research was undertaken in 
the fall of 1974 to examine the internal structure of the 
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formula and the relationship of e>:temal economic conditions 
to ES perfonaance. A data base was created, multi^-variate 
analyses of the internal and external factors were performed, 
and a siirulation ncc5cl \:tis conGtructed. Secauso the rese;,.rc' 
was decision-driven, written and oral reports were prepared 
for specific purposes in support of the revisions being made 
to the BPF for FY 1976. 

Significant oral presentations were conducted as follows; 

1. Presentation to the Meeting on Improvementr in the 
Balanced Placement Formula, October 23, 19 74. 

2. Presentations to ASPER, November 6 and December 6, 1974. 

3. Presentation to the MA Executive Staff Meeting, 
Boston, Mass. , December 12, 1974. 

4. Presentation to MA Executive Staff, January 21, 1975. 
Findings were presented in writing as follows; 

1. Written Presentation to Meeting on Improvements 
in the BPF, October 23, 1974. 

2. Interim Report of Findings and Recommendations, 
NoveiTiber 25, 1974- 

3. Meiw^randum on Representation of Women in the FY76 BPF,^ 
December 5, 1974. 

4. Memorandum on Contingency plans for Allocating 
Resources, January 6, 1975. 

5. Memorandum on the Effects of Unemployment on eS 
Placement Performarjce ; Policy Implications, 
January 10, 1974^ 

In' addition, very substantial time and effort was devoted 
to supporting the finalization of the BPF for FY76 and to 
preparing the actual calculations for each state. At the 
requ;5St of the SS, we agreed to use the data processing fa- 
;iliLies originally constructed for the analysis of the BPF 
to support actual final calculations and printing of the 
funding allocations to the states. Although this was expected 
he an inexpensive by-product of the research process at the 
time the agreement was made, in actual practice the decision 

the BPF research effort during the months of January and February. 



13 

8 



>5 

Many trial EPF runs were needed: each included a complete 
set of six pages of worksheets for each state/ showing per-- 
formance data for both FY74 and FY75; the coir^utation of 
performance ratios compared to the national averages, aiic 
the total stimmary performance score; plus a seventh page 
applying the performance adjustment, the unemployment 
adjustment, and the national budget cut to arrive at a ne%^ 
total of dollars and man-years to be allocated to each state. 
In addition, a one-page summary sheet was prepared, showing 
FY75 man-years and FY76 man-years and dollars allocated to 
each state. 

For each state/ 78 performance itenis were combined through 
approximately 240 calculations to arrive at the total adjusted 
performsjice score, and 6 budget items were adjusted through 
13 calculations to arrive at the final allocation, ^ Each 
conqplete run required about 13,000 calculations and the 
printing of approximately the same niimber of figures, it is 
safe to say that preparation of the EPF in time for the 
February 28 distribution date would have been impossible 
without our support. 

This Chapter presents an overview of the EPF, the significant 
findings relating to the internal structure^ of the EPF, and 
research into the effects of external factors on ES performance. 
For the convenience of the reader who is not interested in ail 
details^ many of the tables and charts are included in appendices 
to this VoiuiTie, 
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The BPF for PY75 and for PY76 consists essentially of a 

c5 : erf crnuHCG ratios thnt are ccrJ^inod in a V7eightefl 
summation to yield a suimnary performance score for each state* 
T^^orked ofit examples for the two years are included as 
Appendix A to this Chapter, The FY75 BPF had 27 measures ^ 
of performance for each state; the FY76 version has 30 measures. 
Each measure f<^r each state is divided by the national average 
for the measure, resulting in a credit index that is equal to 
100 for a state whose performance is equal to the average. 
The credit indexes are combined to yield a summary score for 
the state through a weighted summation process^ where the 
eights are budget or policy weights whose sum is 100 percent, 
detailed arithmetic statement of the FY76 BPF is contained 
in Appi^ndix B, The Exhibit on the following page compefres 
:ha components of the performance measurement part of the 
formula and shovs the initial budget weights for the two 
fiscal years , 

'/he result of the calculations is a summary performance scor'e 

f hat is equal to 100 percent for a state whose overall per- 
"rrir.aTice was equal to the national average^ with better* 
performing states having higher scores. In actual use^ the 
-"'775 formula resulted in scores ranging from 75 percent to 

- »5 percent and the FY76 formula yielded scores ranging from 

7: percent to 150 percent, 

";v.;ro are three technical reasons for the larger range in 

FY76 formula. Referring to the Exhibit the pie chart 
:r:r PY75 showcj 25 percent weight given to employment assis- 
-\2 servic^^s . This was intended to encourage maintenance 
:u.ch services. Of these, performance was measured only 
jr testing (due tc lack of data for the others) * As a 
result, SO percent of the weight was constant for all states, 
Mn^tino The r^rnge of scores, (This .ilso had the effect' of 
riving r^ch or the measured items an effective weight that 
^'^r^ Kitjher t:ian. the apparent weight in the ratio 100/80 or 
/-S) Zn the FY76 formula, all items were measured, 

: c iserond re^.son for the larger range of scores in the 
''^^ f .-rmu^.a jls fch-it several of the performance measures were 
' iBcd to im. rov^^ the formula. The third reason is that 
..i::cho':i for a^t>:st:ng for unemployment, the only external 
wtor taken \nto account in the formula, was changed. Both 

^ .t>cr . z:\\:^r.:jc3 v:ore based~~ l r i paxL ot t— rt^se^^ ^ — result -s 

..ir^^jer.^-^n \d.t..:r in this Chapter where they will be discussed 
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FY 1975 gPF 



DiarCT FI^K-ENT SERVICES 60% 



EHPLOYK'::;. 

assista'jc 
sehvice: .-5;S 



QUAE* 

DIRECT 
IJJDIREC 

TOT'AL 




rrATIVS PUCEMEHT FACTORS 

mtive placekeejt factors 



PLACEMENT SERVICES 
T: EMPLOYER SERVICES 



DIRECT AND INDIRECT 
PUCEMEKT SERVICES 
SMPIjO*!n<£:)T ASSISTANCE 



TOTAL 



E XHIBIT 
I?iITtAL BUCGET V^IGHTS 



■FY 197b REVISED BFP 



QUANTITATIVE FACTC. -^0^ 




QUALITATIVE FACTORS 40^. 



30$ FRODUCnVITr (PLACEHEKT PERFORMANCE . ^ 
30% PER MAN YEAR WORKED) 

TZ7 EFF£CTIVENE5S IN PUiCIKO APPLICAOTS 15% 

^ EFFECTIVENESS IH FILUHG JOBS 1^ 

TOTAL QUANTITATIVE FACT0K5 ^ 

75^ TYPES OF INDIVIDUALS PLACED , 255^ 

25% . nPES OF JOBS FILLED , l^g 

100* TOTAL QUALITATIVE FACTORS W% 

TGTAL ioo:;« 



The i^iiiOTiary score is used to compute peiformance^adjusted 
man-years for the next fiscal year, from a starting point of 
the current fiscal year allocation. To limit the overall 
effect of the EPF on the state allocations, to plus or minus 
10 percent, a range designed to avoid disruption due to too 
large an increase or decrease in funds, a compression factor 
wss applied to the resultant scores, as shown in the examplas 
in Appendix A (Table 6 for FY75 and Table III for FY76). The 
actual computation steps used in the BPF to determine the 
final allocation for each state are rather confusin^r and 
tend to obscure the real effect of the BPF on allocations* 
These steps show initial adjusted man-years, adjusted changes, 
interim allocations and the final basic allocation. Reduced 
to its simplest form, the BPF summary score hat^ an effect only 
on relative share's of ES resources. A state that has 10 percent 
ox national ES man^-year resources this year and has pex^formance 
equal to the national average will get 10 percent of next 
year's man^years (adjusted for unem?loymGnt) , A stato starting 
with 10 percent that has a performance score of 110 percent 
would get 11 percent of next year*s x'esources; if its scoru 
is 90 percent, it will get 9.1 percent. The arithmetic state- 
ment of this is in Appendix B. 

"he published computational steps also obscure the effects of 
national policy decisions. For FY76, the final published 
Vable III* C. 8 showed that the amount of funds available for 
distribution through the BPF was about 20 percent less than 
tlie amour.t needed to fund the man-years ''needed" by the states* 

th>^ 20 percent, 5 percent was du^; to the method used to 
fi^j^i^L, i: for unempioyment , 5 percent was due to changes in the 
nethod for fundincj labor market inf orrration services and 
xna';agr ation certifications j and t'le remaining 10 p^-ccent was 
due to a reduction in the nation<il ES budget. The BPF per-* 
^^"^crmance adjustment had no effect on these changes, but the 
&3enL.;?tion of fcsaJ.ts do^s net make this clear, 

C • M alysis of Internal BPF Pe r^fo rmance Measures and Structure 
1, Purpose uz)d Method 

^he aixalysis of internal factors in the BPF was origini^ily 
designed to ansv;er four question.^ relevant t:o improving 
the H?F for FY 19 77: ^ 

a.. Of the performance ratios in the formula, which ones 

~ h"avg che gi^rat^g^ effuct ui) U ' le i itirtjra-J^-adjn^s-ted — — 

a!! location of man-years? ^ 

t:ie Lon ,L"].oV U'haL are the intor^relations among 
the itf^ms? 

17 
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c. Are there scale effects, such that the absolute or 
relative size of the numerator or the denominator 
of the various ratios is closely related to the 
initial allocation? 

d. How sensitive are the. results to the policy weights 
and budget weights employed in the formula? ^ 

To answer these questions for the FY75 BPP and to test 
alternate versions of the FY76 BPF, a series of statistical 
analyses was performed with the state as the unit of 
observation ; 

a. Analysis of the simple correlations of each of the 

performance ratios with the initial change in man-year 
allocation, and with each of the other performance 
ratios identified duplicative and/or counter-productive 
elements in the FY75 EPF and indicated directions for 
changes in the BPP for PY76, 

fo. Step-wise multiple regression analyses, with the 

percent change in man-years as the dependent variable 
and the performance ratios as the independent or 
explanatory variables were used to identify: 

(1) Which of the performance ratios, make the greatest 
contribution in a step^wise analysis; 

(2) Which variables are significantly related to 
the dependent variable when all variables are 
included, 

c« A simulation model was developed which has the 

capability to project the effects of manipulation 
of perfoririance measure data, the impact cf alternate 
specifications of performance measures, the effects 
of different sets of policy weights, and the conse^ 
quences of different budget weights. The simulation 
model utilizes a series of equations which corirespond 
to the computational met;hQds embodied in the PY76 BPP, 

Based on the results of the prior analysis, a series 
of scenarios was formulated in close cooperation with 
the Manpower Administration; the actual state performance 
^ata for-FY-73--and--£or--EX7jl^^z^e_pr^ the 
model; and the resultant projected man-year ^locations^^ 
for each scenario have been compared with the actual 
for to tjrcert.^in nc.nsit-ivity of tho t-PF to 

changes in each of the items. 
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An^ilyqis thf? FY75 RPF and use of the results in 
the Fy76 EPF 

a. CorxGl:iti::r, /tnalv^is 

(1) Relatioaships between individual measures and 

the rximirifiry score 

The first; step in the statistical analy^^is \-:eiS to 
cxamiui^ the correlations among the factors in the 
FY75 3PF on a cross-sectional basis among the 52 
states (including D,C, and Puerto Rico).. The simple 
correlations of each of the 27 performance ratios^ 
the unemployment rate^ and the number of man-years 
paid are pro^r snted in Table XI-1, 

It V7a.:i. ^iXpecb3d that/ since each performance ratio 
is arithneticaliy related to the percent change in 
m::n-year3, all performance correlations would be non^ 
negative. As can be seen in Table 11^1, this expecta.^ 
tion v;ap not: fulfilled with respect to the group of 
ratios 'in^iez the lie.iding Percent of Individuals Placed 
by Type of Job, Only 3 ratios (Duration less than 
4 r'ays. Skill Level VI, and V/age Rate under $1-60) 
v^^re oi^jnii'lrantly positively correlated^ and all 3 
had the lowest pol:cy weight {1) in their group. One 
rdtio (Duration over 150 days, policy weight 3) was 
negatively correlated, 

Th^i nntp jyp.^ent r^te was not significantly correlated, 
?hr .imi'^r c' nanyears paid Ucis negatively correlated 
v'ith pel jn"- change in ^T^an-years, which was expected/ 
basr.l or ..j. ^rts that the larc =ist states faced the 
*70't:^t In FY75 ';PF allocation process. However, 

reo/ilt.^ pre;:ontnci later in-tUxs report lend to dif- 
fei^^'-h int:ti:'prGtarIons in x'elation to both of these items, 

. {2) of JritrK 

^ vibl XI—' prf3'sents tha correlations artong the per- 
-i:.:! r tior. 2or Typf?^5 or Jobs* In the original 

:jlan icv ^..iiio ^naLysis xt w^;^ ext>3ctad that significant 
''C'z^t.iv: cohere uttions ;^*ould be found between^ for 

> ;,9h-wage ievols and high-skill levels, and 
.\et\\.3n ;mcrt— ciuration jobs and low— skill levels. To 

:yc^~a7:t\Trrtr-.- -i :T r is l^ypothcGi -^— wa^ — :.':;nf irrtted^ — Thp 

lorcen'r individLuAs placed in short-term jobs is 

'jo^\^ tJ : * ^'crisl^t^^d with '^kLll Levels V and VI; 
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Table I!--! Correlation of FY75 BPF Performance Factors 

with Initial Percent Change in Man Years (dMY) 



^ Correlation with Peircant: 
Performance Factor Change in Man Years* 

^ Individuals Placed, Percont of Plan (IP/Pln) .447 

Placciuent Transactions^ Percent of Plan (P/Pln) ^5X8 

j Individuals Placed per Man-Year (IP/MY) *845 

L Placements Transactions per Man-Year (P/MY) a8^3 
Percent of Target Groups Placed: 



L 
L 



L 



) 

L 



Veterans (VAA&R) =749 

Minority (ll/MA&R) -645 

Poor (P/PA&R) .580 

JIandicapped (H/HASR) ,557 

UI Claimants (Ui/UIASR) , »58J. 

Youth ' (Y/YA&R> *483 

Older Workers (O/OAsri) .629 

Percent of individuals Placed by Type of Job: 

Duration: Less than 4 days '-ftSOS 

4-150 d^ys .ll*^ 

'Oyer 150 days -o3£3 

Skill Level: I -.274 

II -.080 

III ' -.291 

IV e28?. 

V ' .198 
VX -470 

Wages: Under $1.60 .336 

$1,60-2.43 *071 

$2,50 and over -«184 

Penetration Rate .831 

Percent of Openings Filled .846 
Individuals Tested (GATE and NATD) as a 

. Percent of Individual!' ccunreled '522 
Individuals TcKtcd (Other) as a 

Percent of Openings Received * o293 

UneinployMcnt T^ate ■ o070 

_£^X3LKan Years Paid -,313 



ERIC 



*Coriolati'xJi\ cocl'iiciont ir.ust tixcot^d * 3C0 to be statistically significant 
at thf; *05 lovol . 
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and the percent placed in long-term jobs is negatively 
coirrGlaued with percent i^^iaced in the, lowest v^age jobs* 
The other significant corralacions between duration and 
skill, however, present a niixcd picture. 

Of most inteirest in Table 11*2 ar^ the correlations 
bcu'^/eo^. w'^r-isurGs of the sane type* Among the Duration 
measurt5S, percent placed in jobs over 150 days is 
negatively correlated ^;ith the other Itwo categories* 
In particular, the correlation with percent placed in 
jobs 4-150 days is -*373, a negative correlation 
implying a direct tra ^^-off between the two categories; 
similarly, among the $l.e,0 * 2.49 category and the $2»$0 
and over category, iha Skill Level categories have a ^ 
mixtura of positive and negative inter-coirrelations * 

The reason fo:c the observed inter*correlatione appear p 
to hav^ more to do with the technical specification 
of t^ho' iii^'^-^rures than with the substance of the per-- 
f. 1 ^"r:e t.ting measured* As an example, in the 
Du< * ^n mf>.;sure, jach Category is defined as appli'*^ 
can\.f ;;:'=c£d in that category as a percent of all 
applicants placed* Therefore, a::ithmetically , ;i.f the 
pi^rcert in o le category increases, the percent in one 
or both of -^.he othrjr two must decrease. Purtherraore , 
isince the policy v;ei'-;hts qive higher rev^ards for 
increased perc£3ntagon In th^^ longer duration categories |, 
fhf^re 13 ar; incentiv-?- t^ manipulate the data by 
r^?;,^n'lng or the original job order form, the highest 
r:U.at:or zoj.p.f similarly for Skill Level and Wage 

Pa^i* BnC':!i:3e t^Lre -was no item in the FY75 BPP to 
co\^^.:to,rb.Alance n^ch manipulation, states may well 
h-',va mdertn^:^n it, Rnroinraendaticns to correct 
trh'G probjor .v:.o retl^-'':^oA in the FY76 BPP analyzed. 
:n Sr-ntlor I'l-B. 

ir.^l ; , a sf^^t of rc relations 'vas studied to test 
I'a^ ueo -s that '-'.r^BQ states who placed higher 

xri-it-r' ^r^rh.TLSio o>i '^.'^rvTCe to the disadvantaged and 
rr- ot.ro^ 3pf^c>p'' tiJigo\^. Cjro'jps were p<>nalized by the, 
T';?:- ^ I . ?uc"\ u hyv-'Ctn'?sis can be v.ej:ivcd from a 
*n;i e^y^.u :1 ^ r:.:Tt.^,A^ort uhich cleols with a given labor 
ai t a c;i-yerr pOd^^— 4djae^-^w_ith relatively fixed 
r^_r'our-er* {"'hjs .,5 equiv.'.lent to treating the ES ^ 
-is r .^n^ciMc fvrm operating on a !4arshallian % 

sue \t 3^ i\ LyrjoXi^'.^iSf even if true, would not 
iu^cft£.s ^ri, ly bo TLr£ i*ibl<= using aggregate statewide data 
ref lertiT*g ?.? adiuirments to changing policies ^ 
pvioritL-^-: ail t::30urces over time* 
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From the correlations presented in Table XI^l, it 
is clear that better service to the target groups 
is positively correlated with the FY75 B?F cillcca-' 
tion* Table II-3 dif^nlc^ys the correlations air.ong 
several of these performance measures. The first 
item^ Individuals Placed as a Percent of 'Plv^n (IP/Pin) 
is significantly correlated only with percent: of 
Openings Filled (OP/OR)* The lack of a reloticnship 
to other items possibly reflects the Sc:c*; t.hst plans 
are adjusted quarterly via negotiation bi^twa^n the 
state and the regional office in r^^sponcj to .::h.v,nging 
conditions in the state. For this rcasna and because 
the planning process as a whole has iiaprac*; sion^ it 
is recoiniuended that performance in relatiioix to plan 
be eliminated from the BPF. 

Of significant interest is that the ratp> of Place-- 

ments per man-year (IP/MV) is positively coirrelatea 

with the percent of each tarrgeh aroup placed ^'^-^ 

with penetration of the job market (OR/Fmp and OF/OH) . 

In addition, the placement rate for each caugat group 

is positively correlated with the rate tox^ itvezy other 

group and with p^^inotration of the job mrKei* These 

findings indicate that the better perrornvince ntates tend 

to do a better job acoordiug to most rr.casr.i of perrornianc 

Two other items in Table XJ-3 are of iatere":t. First, . 
the state unemployment rate iv) ^ which rdghc be expected 
to be negatively related to ES perf o3:mancc , is in fact 
negatively correlated only with the placement r"\tG for 
handicapped applicants. (The relationship of unemploy- 
ment and other extern-^l factors to ES perforirance is 
:curthei: explored in Section C of this Chapter*) 
Second^ size of the EJ^ agency, ^as mece^ired by man-years 
(MV) # has a significant negative correlc^r Acn witli only 
3 performance measiu'^s (IP/MY^ P/PA&Rf and OR/Emp) ^ 
although it tund£i,,to. be negatively related to all 
measures. It does not appear that site alone is a 
najor factor in ES performance or in the FY75 BPF 
allocation process* 

MulLiple Regr^^sion Aunlysls 

The correlation analysis presented thur does not 
permit conclusions about che sensitivity "of chfi 
BPF allocation process "to oacn of "the^autors when 
all factors are taken into account at the saire time- ^ 
*p ^ ^ V T e r'Po '1^ t r^'Ot'^"^!'. p TPp'T'orrip^ 'irs"^ 1 i ^ is cin . 
at^propriate tool* A st.ep<-wi3e analysis; seleccs firsc 
the factors having the grej^iest valua in e:<pl-:^ining 
the end result and therefore identifies the factor:^ 
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Table IT- 


3 Correlations '?mong Selected 


PY75 


















Porfoi-,T;-3nco 


Measures* 



















a) (2) 


(3) (4) (5) 


(6) 


(7) 


(8) 


(9) 


(10) 


(11) 


(12) 




(13) 


(1) 


iP/:">" 


l.OCO .295 


.174 .057 .020 


.150 


.193 


.020 


.064 


.166 


.479 


-.127 


-.107 


(2) 


iP/:;, 


1,000 


o 730 o5V7 ,-i7a 


.512 


.483 


.378 


.581 


. 646 


.63*' 


-.121 


-.3 20 


(3) 


V/VA 




1.000 .692 .434 


.792 


.794 


.457 


.867 


.556 


.618 


-.25 4 


-.108 


( ■) 






1.009 .771 


.6 31 


. 543 


.663 


.722 


.527 


.441 


-.271' 


-.133 


(3) 


p/r.^: 




1.000 


.520 


.453 


.549 


.485 


.592 


.355 


-.19 5 


-.338 


(■3) 






1 


.000 


.319 


.532 


.774 


.373 


.422 


-.427 


-.220 


( ') 


ui/v: SR 








1.000 


.460 


.716 


. 34 7 


.524 


-.275 


-.065 


(3) 


Y/y \' " 










1.000 


.472 


.440 


.333 


-.IOC 


-.253 


(?) 


0/CV - 












1.000 


.521 


.487 


-.269 


-.011 


(IC) 


OR/:''' ■ 














1.000 


.344 


.198 


-.344 


(11) 


c?/o: • 
















1.000 


-.052 


-.130 


(13) 


u 


















loOOC 


-.044 


(13) 


MY 




















1.000 



*See Table 'I-l for explanation of abbreviations 



to which the allocation formula is most scnsiti'.e* 
Because each factor in the formula is arithrieticalJy 
related to the end result of the formula through 
policy v/eights ar\C h.:J^;^.t weights ^ one would expt^ict 
the regression analysis La explain 100 percent, of 
the variation in end results {c?.nd in fact th^ equa- 
tions should become cv^rCeteimined) . ^ 

Appendix C*l presents the derailed resulf i ot the 
analysis* The dependent varici)le wa>: p^^oont change 
in man-years* The independent or eKpletn£.to*"y v^^ricii^ies 
include all 27 PY75 EPF perforiiiance raticr- , plus PY73 
total man-years (included to test the partial relation- 
ship of this item to zhe dependent variable) . Of ail 
2? performance ratios , cnly lu were statistically 
significant in the analysis, 'rhis is due primarily 
to the inter-correlai-ions among the ratios , ospt^ciciily 
those relating to Types of Job5?* FY?3 r.^jiLV/ears albO 
was not significant* 

However, the single most important factor both as 
measured by sizu coefficient and by percent of 
variance explained is the unGmployment rcit;i* (This 
result is reliable, because the unemployment r^T-te is 
uncorrelated with the performance measures*) The 
size o£ the impact is attributable ):ioth to tlie size 
of the adjustment in FY7 5 BPF Table 3 and to tl:e fact 
that the adjustment applies uniformly to 6C percent 
of the formula weight* (In fact^ the adjustment applie 
to 75 percent of the variable portion of the formula* 
Deducting the 20 percent fixed weights In Table 5, 
leaves 80 percent variable weights* 60/S0=*75*) 
the unemployment rate by itself bears little relation- 
ship to the indivi^iial ES per£ori?iance rotios, it is 
clear that tlie BP? allocation results ar-^ unduly . 
affected by the PY75 method of adjustment. 

Additxoniil analyst:5S were performed, using policy"* 
weighted perforiii^nce iacios> credit i^idexes, and 
aOjusted budget weights a;^ the explanatory variables* 
In each caide, the results with respect to unemploy-- 
,ment were similar, altr*o\;gh the analysiis using 
adjusted budget weight:;^ obviously showed all f^xctors 
as significant, due to the arithmetic relationship to 
the dependent variable* 

Simulation 

To permit testing the offects of various n\i.nipulation 
scenarios, for the FV7S B?P and to tost .-ilternate formu^ 
lations of the FV?^ BPF, a generalized simulation model 
was created* The general rormula for the Kodel is 
similar to that in Appendix B* 
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The simulation system ralies upon a data base of 
;jS performance data for each, -For th4 F^75 BPF, 
this data base was created directly from performance 
dz-.t?. ccr.tcArtcid en th^ BPF fonms. For .FY76 testing f 
Fy7 4 performance data was extracted from ESARS tapes 
containing FY74 reports from each of the 52 states. 
All policy weights were external parameters which , 
would be TTiOdified at will. Policy weights (PW) are 
integers vmich can be set at any value. For exainple^ 
to exclude any particular performance ratio from a 
particular test of the formula^ the PW can be set to 
zero and similarly for budget weights. 

In preparation for the October 23, 1974^ BPP Review 
Meeting, three simulations were performed, even 
though none was planned prior to December 1# according 
to our original project schedule. The results of 
these simulations are sximmariiEed in the first three 
tables of Appendix D. In the first simulation, each 
of 51 states (excluding Puerto Rico) was assumed to 
htive achieved a 10 percent increase in productivity 
for placement transactions, with all other performance 
relationships (ratio of transactions to individuals 
placed, placement rate of target groups, etCo) held 
constant. 

•\ 

Overall, 7 states, including 4 of the 8 lowest per- 
forming and 3 of the 5 highest, would have experienced 
no significant improvements in man-year allocations had 
they had 10 percent higher productivity p 4 states 
would have improved by an average gain of approximately 
10 percent and the remaining 40 states would have 
improved by an average of about 5 percent. 

Next, it was assumed that each state would manipulate . 
data on Types of Jobs such that 10 percent of place- 
ments would be reported in the next higher category 
for each of the items in FY75 BPF Table 2B. Only 
2 states v:ould have benefited more than 5 percent; 
from the manipulation- 

In the third simulation it was assumed that the un^ 
employment rate adjustment was eliminated from the 
FY75 BPF. If this were done, 11 states would have 
gair.ed at least 5 percent in man-year allocation ^ 
10 s;tatcs would have lost 5 percept and 30 states 
would have stayed the same. The distribution change 

c.......j^ ;»v.. . -years , iii^icat-n^ tuar tuxe uneuipxOj\./^n^ 

rate adjustmant affected the low-performing states and 
the high-performing states equally, although not 
necessarily equitably. 
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SiriiUlationE FY75 BPF wore liJui-ted to th& thret^i. 

described herein, because BS national/ regional 2ir,Q 
state reno.TocndationS/ and tho results of the ana?.vjs>\3 
reported herein pointed toward sxgnifici:nt r^rcxfj^^^oiis 
in the BPF i-or pY76 which, v;hile retaining most of tlSts 
basic cohceotrj of the TYVS BPl , would improve the 
forratilu/ inc so ircentvves to improve r.S performance, 
and reduce tl.o ;DOtential for nanipulation.- Briefly^ 
the ror.ibined irecctnTr.enda^ions included elimination of 
planned perfornance, addition of measurer^ of penetra- 
tion of the potential applicant market'^ revision of 
the JjpGcif icntion of me:i?;ures of types of- jobs, 
replacemf^nt jx the couiv^clir.g and testing items / and 
elimination of fixed i^:"iirG, 

Analysis ot ^he BPF for Fy76 

a. Introduction 

As indicati;\ in i^hc preceding Section,^ a nuinber of 
changa:; v.ere rjcomiiended fcL" incorporation into the 
Fy76 BVF, -ed on research and upon the actual, 
exp^jrieica In usir^;? thG FY75 BPF. To teGt the 
ef facets cf thcrie changes ^ the. general sitnuliition 
model v?.3 nse'i to test snvcrrl v'ers.iDns; c 
R^plJ Cfi^iion of th2 FY;5 BPF ui^ang new (FyT-j) pariV.nnance 
.l^;c3; i'\d alt^maU"; BiTF's i^ifiocting new specification^ 
* f pax i 01 rr^nc - ra \ :^ yj^ . v 

Th^ :,xin:;:pal '■^i r ^ences ?;otv^^ -n the FY7S BPF and 

.\:;.c:'; ' ;7'' ':?p '^ ^^^^jIc rj.^.in^j^err (s^e Appendix Al : 

' t.:. ' Mc.\ rf tho Job f^.^,r1^o.t 

^ nc^ . ; ^.vj. \. r '^^Tt. i cultural er.plv>,:iVr;aCp 
^ ^t. ^'.h;, •^r''Cxos.i ' ^ ih- placxng iniividualB 
l . n:\^^ 9"*^^ n.T;ent in approxiTnr?.tcly 
;: pp.T .i^r.vi i^T^'/loy^lent in tlioso 

^ ■ *s^' s 1^; oc ; -^tnil U,S- 3ruploy7Tient. Xr 

X.. ')jal iiDpioymejiit v/ar^ anoludeu. 



■ ' to j''=j;sure ef fr.ctivenur^s in 
■7I^c ^xh'^ . . v.t p^^u>rt:l':il. T'ne measure 
^■iw r -5-:l. c "in: A ^ "5^^^ ^t'':e^^raIs as a pereen'r. 
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(3) Item IIAI, Placement Rate Of Target Groups has been 
expanded to include women and migrants as target 
groups , 

V7omen were included because national data show 
that the placement rate of women is lower than 
inen^r total and in the minority and poor ta^'get 
groups ? that v;oTncia are under-represented among 
the other target groups, especially veterans; 
and that women are more likely to be ^placed in 
jobs with low wage rates. 

Migrants were included in response to recent 
court decisions and MA policy responses, .although 
data ware available only for the period 7/1/74 to i 
12/31/74, 

(4) Item IIIB* measures openings filled in each category 
as a percent of openings received in that category, 
and replaces percent of applicants placed, 

(5) Item IIA2» measures effectiveness in placing counseled 
applicants and replaces the testing items, 

(6) No hold harmless provisions or adjustments for 
external factors were included, pending further 
budget information and completion research into 
external factors. 

Comparison of results from FY76 alternates with 
Fy75 replication \ 

Appendix Table D,4 presents detailed state-by-state 
results of the simulations. For comparison , ^actual 
results £roz\ the FY 7 5 BPP are also presented. Appendix 
Tables D.5 through D,9 summarize the results obtained 
by comparing the percent change in man-years for FY75 
with the percent change that would result from each of 
the four simulations for FY76« 

In general, states that did well iinder the FYVS BPP 
would also do well under each of the tested alternate 
versions^ and vice versa, although the dispersion of 
change v/as greater for the 3 alternate formulas. An 
initial examination was conducted which focused on 
states experiencincf extreme changes from FY75 as 
compared with the simulation* 
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In the first case, one state (WashingtOii) which had 
less than 5 percent gain in PV7S had an ^iicatefi 
increase of over 25 percent in th€i PY7S SeplicatlcsSi. 
and had even greater gains in each of the alternativies 
because the state reported much higher performance i^ 
FV74 than it had in PY73. It Increased tfie total 
nmtdMr of individuals placed (as opposed to a general 
decrease) , placements per man*year, its placement rate 
for ea^'/ target grpuPf and its penetration rate. At 
the sati^^' time, the ratio of placement transactions to 
individuals placed dropped from 2.36 to 1.44. These 
gains were all greater than the national average, and 
cause the high results on all simulations* 

In the second case, a state (Michigan) which had a 
slight loss in FY7S (*3.68 percent) would experience 
a loss of more than 28 percent according to each of 
the alternate formulas and an 11 percent loss on the 
Replication. Michigan increased its productivity, 
both absolutely and relative to the national average, 
but its combined placement rate for target groups fell 
absolutely (and from 69 percent to 56*8 percent 
relative to the national average, vrtiich increased*) 

Penetration of the ejnp^loymtsnt market also dropped 
slightly. The lar^r loss for Michigan under the 
three alternates as compared with the py75 Replica*- 
tion derives from 3 additional factors: 

(1) Michigan's penetration of the applicant potential 
/defined as new applicants and renewals as a 
percent of unemployment) was 58.6 percent of the 
national average, and percent placed was 92.5 
percent of the average. ^ This may be due in part 
ro factors in the auto industry, because 47*36 
percent of applicants were 01 claimants (the 
group with the lowest national placement rate) c . 
contparad with 32.83 percent nat^ioaally* 

{?) Michigan received a 2 percent increase in man-- 
yoara as a result of the unemployment adjust^nt 
in thti fY7S Replication, omitted from the 
axterr.ates . ^ 

(S) MicnjLgan did better than the national average on 
Types of Jobs under the PY75 Replication, .but did 
w^rstvunder the cLxternates. The comparison data 
presev:ted in Appendix TableD*10 is illustrative of 
■Lht; i::,;,.i;ct ct respeci.fyii^g this item. ■ For iilUo- 
trative purposes, data is also presented for 
OklahOKiP.* (In both cases, the data for alternative 
A exclude agricultural jobs.) 
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Under the FY75 Replication, Michigan exceeded 
the national weighted average percent distribu* 
tion of individuals placed by type of job for all 
three components of the formula, whereas Oklahoma 
was lower than the national average^ Centring 
the two states, Michigaii had 9.8 percent of 
applicants placed in jobs of less than 4 days ^ 
duration, compared with 18.5 percent for Oklahoma) 
it had 58^0 percent placed in jobs paying more 
than 52.50, compared with 28.9 percent for 
Oklahoma. 

Under the FY76 Alternate A, Michigan iras lower 
than the national average weighted percent of 
openings filled by duraticm and skill level, 
but was higher for openings filled by wage rate^ 
Oklahoma filled a higher percent of jobs than 
the national average in evei^ category, and shows^ 
a substantial gain as a result. 

The two different specifications of these measures 
are DOth intended to provide an incentive to 
states to place applicants in the highest quality 
job consistent with their skills, abilities, etc. 
FY75 BPF Table 2B provides this incentive, but 
it may penalise those states having relatively 
fewer Ipng-term, higher-paying jobs. The FY76 
BPF provides an incentive to states- to fill all 
openings received, and the policy weights provide 
an incentive to fill higher- quality jobs. It 
will be noted that the national averages for 
percent of jobs filled for Duration under 4 days 
and for Skill Level II {Clerical, Sales and 
Service) are nearly 100 percent, indicating that 
perhaps there should be no weight given in the 
formula. 

Sensitivity Analysis of the Fy76 BPF 

To test the sensitivity of the three FY76 Alternates, 
the correlation and regression analysis techniques 
applied to the FY75 BPF were repeated. The correlation 
analysis results can be summarized very concisely. All 
performance ratios except individuals counseled as a 
percent of new applicants and renewals were positively 
correlated with the percent change in man^years in all 
alternates, even when budget weights for the items 
Wur^ zci'j. This rnr^ult ccru:''^ b-r-rn^iFe no perfornance 
ratios were negatively inter-correlated^ -and most wcro 
positively inter-correlated. The tables of correlations 
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between FV74 and FY75 performance measures and the 
percent change in man-years is shown in the follow- 
ing tablea Sindlarlyi the regression analysis 
results can be guicicly summarized. Because the 
variation in percent change in man-years was a direct 
arithmetic function of the performance ratioSf with 
no independent variation introduced by external factors 
such as the unemployment rate^ the equation became over 
determined when the last variable is included and there 
was no residual variation. The coefficients of all 
ratios are positive and statistically significant. 
In the actual FY76 BPF^ there was some residual varia* 
tion, due to the unemployment adjustment^ as shown 
in Appendix C,l and C,3, 
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Corralation o£ Fy74 and F)^75 Perfonaa&ce Data i^itJi 
FY76 BPF Percent Change In Man-Yoars (dMX) 



Performance Factor 



Xndlviduals Placed per Man Year (IP/MY) 
Placement Triunsactions per Man Year (p/my) 
Applicants Served (A&r/UNBMP) 
Placement Rate (IP/A&R) 

Non-Agricultural Penetration (OR/Non-Ag EMP) 
Non-Agricultural Fill Rate (OP/Oil Non-Ag) 
Agricultural Fill Rate (OF/OR Ag) 
Percent of Tiurget Grovips Placed: 



Correlation with Percent 
Change £ti Man Years* 



Veter£ms 
Minority 
Poor 

UI Claimants 

Migrants 

Women 

Handicapped 
Older Workers 
Youth 



(V/VA&R) 

(M/MA&R) 

(P/PA&R) 

(UI/UIA&R) 

(MG/MGA&R) 

(W/WA&R) 

(H/HA&R) 

(P/OA&R) 

(yAa&r) 



Individuals Counseled (IC/A&r) 
Individuals Placed After 

Counseling ( IPC/IC) 
Percent of Individuals Placed by Type of Job 



Duration : 



Wages : 



Less than 4 days 
4-150 days 
Over 150 days 

Under $2.50 
$2.50-$3.49 
$3.50 and Over 



Skill I^vel: 



I 

II 
III 
IV 
V 

VI 



FY74 

.837 
.866 
.533 
.816 
.732 
.769 
.401 



.766 
.594 
.680 
.653 
NA 
.759 
.734 
.817 
.608 

= 055 

.5X9 



.274 
.643 
.760 

.6 )€ 
.7"*4 

.3 

.7t > 
,747 

,677 
.536 
.435 



L 

L 



♦correlation coefficient must exceed .300 to be statistically 
significant at the .05 level 
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mi 

.898 
.851 
.517 
.800 
.769 
.678 
-.007 



,803 
.731 
,558 
,478 
,193 
.721 
,796 
.779 
,622 

.146 

,445 



,186 
,427 
,617 

.453 
,590 
,672 

.383 
.624 
.516 
,649 
,261 
,295 
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4. Remaining probiems in the internal structure of the BPF 



In the process of developing the Balanced Placement 
Formula and revising it for use in FY76 , considerable 
time and attention was paid to including all quantita* 
tive and qualitative measures of ES performance r .to 
reflecting the many legal and judicial mandates for 
services to special groups, and to providing Incentives 
for state agencies to improve both the quality and 
queuitity of service. The incentives are reflected in 
the policy weights and budget weights assigned to each 
of the performance ratios. Although the EPF weights 
give a surface indication of incentives, they do not take 
into account some very important aspects of the problem 
of weighting the parts of a summary measure* 

First, the effective weight of a part of a summary measure 
has two components: its explicit weight in the formula r 
and its effective weight deriving from its variability. 
To illustrate the problem, consider Table 11*4 on the 
following page. Column (2). shows the actual budget weights 
assigned in the BPF for the quantitative performance 
measures, and column (3) shows the ratio of each to the 
weight for individuals placed per man-year (IP/MY), This ^ 
column shows that it was intended to give half as much 
weight to placement transactions (P/MY) , 40 percent as 
much weight to the placement rate (IP/Aft) , etc. 

The effective relative;, weights shown in column (6), 
hov7ever, are quite different for most items, because 
the standard deviations of most of the ratios are quite 
'different from that of the first ratio, as shown in 
co^lumrs (4) and (5) * The placement transactions per 
man-year has an effective relative weight equal to 77 percent 
that of individ^jals placed per man-year, while the effective 
weight of the placement rate is only 7 percent as much, 
ir.staad of the intended 40 percent. Similar calculations 
coul<3 be r.^Ao. with respect to the qualitative BPF measures* 
To correct: tor this problen, it is necessary to compute 
correcticu factors for each measure, dividing the desired 
budget weight by the standerd deviation of the measure. 
Mtiltin iyin : 5 xch actual performance ratio for each state 

the appropriate correction factor will result in adjusted 
P';r£orniancc ratios that enter into the formula with the 
desired effective weight * 
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^ , , f- n r~ r~ p— p r~ f- r r~ r' i — i — i"~ r 



Indl cator 

Individuals Placed per 
Man^Year Vtork-d (IP/HY) 

Placement Tre^ sactiona 
Man-Year Work* d V^/m) 

New Applicants and 
Renewals as a Percent 
of the KuHiber 
Unemployed (A^'/tJ) 

to Individuals Placed as a 
^ Percent of Wev Applicants 
and Renewals (IP/AR) 

Konagricultural Openings 
Received as a percent 
of En5)loyment (OR/E) 

Konagricultur'il Openings 
Pilled as a Pe rcent of 
Openings Received (OF/dR) 

Agricultural openings 
Filled as a ^r^rcent of 
Openings Received 



Table II** 4 Variation and the True Effective Budget Weights Selected 
Performance Indicators Used in the FY 1976 BPF 

correction 

CDn^nents of Effective Weight Effective Pactor for 

Relative Desired 

FY74 FY76 Budget height Variation Weight Weighting 

Average Actual ^ Ratio to Ip/MY Standard Deviation Ratio to IP/MY [(3)X(5)1 [(2)r(4)] 
ill ill iiL ^ iSl iSl ili 

139*2 *eo 1 41*4 1 1 .0048 



284*3 *10 .50 64*0 1.55 *?7 .0015 



80*1 .07 .35 41*2 1.00 .35 *0017 



26.6 *08 .40 7.0 .17 .07 *0114 



10.0 .05 .25 5.2 ,13 .03 .0096 



62.3 .06 .30 , 12.5 .30 ^ .09 . 0048 

96.2 .04 .20 16.9 ,41 -08 . .0024 



The second problem is even more complex, fta shovn in 
the correlation Table on the following page, there is 
substantial inter-correlation among the several quanti- 
tative BFF performance ratios, with one exception* 
There is similar inter-correlation among the qualitative 
f£etore# and in particular bet^reen the total placeioent. 
rate (XF/ah) and the placement rates for the individual 
target groups. As stated previously, the inter'-correlation 
indicates that better performance states tend to do better 
on all measures of performance. 

The problem for the BPF is that the inter-correlatlon 
leads to double coimting. Consider two arbitrary 
performance ratios that are perfectly correlated with, 
each other, such that when one intir^ases by one point# 
the other increases by the same amoimt. Then both must 
ba measuring the same thing ^ and either could do as well 
as the other. When both are included in a composite 
formula such as the BPF^ the effect is to double count 
the measure* There is 3 complex method that can be used 
to correct for the problem, but a simpler approach is to 
limit the number formula to statistically independent 
measures. It had been planned to perform a factor 
analysis to identify such independent measures # but this 
was not completed* However, analysis being conducted by 
the USES National Office staff is proceeding along those 
lines . 

Finally, although improvements were made by including 
counterbalr^ncing items in the FY76 BPF, a number of the 
performance measures can be manipulated to the advantage 
of the states. In particular, there are 11 performance 
ratios whose total budget weights, add up to 30 points that 
have a number of new applicants and renewals as the 
denominator > while only one counterbalancing measture with 
a budget weight of 7 percent has that number in the ^ 
numerator* Since the number of new applicants and renewals 
registered with the ES is in part under the control of the 
CSi, there is a 30 to 7, or 4 to 1, incentive against 
rc-^gist^jtring individuals who have not been placed. There 
is a similar incentive against reporting job openings that 
nave not been filled. 

v^trt do not recomm^na that there should be incentives for 
^tu^rely registering applicants or listing job openings. 
However, the work application and the job order are 
b",sic documents necessary for serving applicants and 
.>;n;jloyers at the operating level. With the increased 
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Table Ii~5 CorreXations Among Performance Ratios for 

Psrfomance Data Usad in tho yif76 BPP 
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.197 
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.909 


.289 
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use of automated aids to the placement process, it is 
Imperative that accurate files be maintained to permit^ 
the greatest aawunt of service to the coiniaunity. 
Therefore, we reconncnd ^hat measures of ES performance 
be developed and used in future funding allocation formulaft 
thitt neither encourage nor discourage applicant regist^fs* 
tlon and :}ob listings. Measures of this type are deacrit>&d 
in the Methodology Guide, Volume 3 of this report.. 

An alysis of the Effects of External Factors on ES PerfonRance 

1. Purpose and M^jthod 

The analysis of the relationship of external factors to 
ES Performance was initiated to research several issues ^ 
related to the BPP funding allocation process* First , 
it is intuitively obvious that such factors as labor 
market size and complexity, composition of employment, 
characteristics of the labor force, and unemployment 
have an effect on ES performance, and it was assumed 
that State ES agencies should not be penalized for poor 
performance due to factors beyond their control. Second, 
the unemployment rate per se was found to be an inadequate 
reflection of the influence of the external factors. Third 
it seemed desirable to set output performance standards 
based upon .the' jferformance of similar states # rather than 
national average performance. Finally, it would be 
preferable to set realistic performance goals based on 
the potential market and need for public ES services and 
to measure performance against potential ^ rather than 
against national average performance. ^ 

The following factors were hypothesized to be related 
to ES performance ; 

a. Stable external factors 
(i) Industry coipposa tion 

It was hypothesized that the higher the percentage 
of e;T>oloyTnent in construction, manufacturing and 
go^^ernFientf the lower ES performance would be, because 
each of these industries has distinct hiring channels. 
Direct measures of concentration, dispersion^ and the 
number of alternate hiring channels have not been 
developed. 
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(2) Labor force composition 

Adults of analyses by the Center for Applied Man*- 
power Research showed the percentage of labor force, 
in low'wage^ low-skill occupations to be positively 
related to BS performance at the statd Xem^l^ but 
percent in minority groups was not related^ - 

(3) Size of area 

The hypothesis was that ES performance will be lower 
in larger areas due to the existence of coii^t'l;ig 
institutions aiid agencies. 

ba Volatile external factors. 

(1) Unemployment 

It is often assxntied that ES performance will be lower 
where the unemployment rate is high* Analysis of the 
internal factors in the FY75 BPP resulted in the con*- 
clusion that the unemployment rate per se did not 
have a consistently significant relatXonsiiip to per- 
formance, and other measures were tested. 

(2) Growth 

The hypothesis was that ES performance will be 
higher where there is a higher rate of growth in 
employment. 

{3) Policy and law factors 

It was hypothesized that policies and laws such as 
those that require the ES to perform enforcement 
activities , provide work tests, and list openings 
from federal contractors will result in lower ES 
performance. 

The analysis was conducted in two major phases.^ ln the 
first phase, analysis focused on the effects of external 
factors on ES performance at the state level, in part 
because it was hoped that some of the results could be 
utilized in the PY76 funding allocation process, in part 
because USES wanted to explore the feasibility of setting 
ES output standards based on groupings of states, and in 
part because state-^level data on ES performance was readily 
available. In this phase, several different combinations 
q£ factor j; ;;t-i,o ^t-r t^-^ , c^nu rho re;=ul ts of sciiie of tht^e 
tests are described below. 
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The second major phase focused on the effects of eajternal 
factors on ES perforn^nca at the labor area level. The 
hypotheses listed above ate derived from a oonceptual 
fraiMwork that relates to individual labor areas. By 
definition, the labor area is an integrated social economic 
system, xi constitutes the environment within whicdi ES 
services are actually provided through approximately 
2500 ES local of f ices , ea'^Ji of which is a locally-managed 
entity in a distinct labor market, with specific objectives^ 
approaches and perfomance results that are d€?pendent in 
part on local conditions. Although the state is the key 
level for funding allocations and for policy definition, 
state* level data "on performance and on external factors 
are at best aggregations of data from individual lalx>r areas. 

The primary method used in the analysis of the ^effects of 
external factors on ES performance was multiple regression 
analysis. The regression technique proceeds by calculatin9 
the statistical relationship between each of the external 
factors and productivity when all factors are taken into 
account at the saine time. The results from this step 
show how niuch performance increases or decreases in 
response to an increase or decrease in each factor and 
shows how much of the variation in performance is 
accounted for by the variations in the external factors 
when *all factors are included. The final step in the 
regression analysis is to predict performance for eacih 
state and to comoute the deviation from actual performance. 
For the prediction equation, a regression coefficient is 
calculated for each external factor. The regression co* 
efficie]*t for each factor indicates the amount by which 
produ-Jtivity is ejected to increase (or decrease) as a 
resijlt of a one-point increase in that factor, holding 
all otner factors const=int, A constant term is also 
computed. {Sec Appendix 2:, for detailed results,) As 
used in the ^in^lysas reported below/ the results show 
the factors that ure significantly associated with high 
< y low p'^rtot^v^^.noa , but one canriot assume they caused 
tJie observe'^ iii-\icrt:nce^ , Rather , the significant 
^actors am rhc- i.atuvc of constraints that show the 
effect on diffevences from average performance^ 

Analy:3is Re^ulf^j ^t the S^<4te' Level 

a Tlie rPsrltii the first stage of p;u3tiple regression 
analyses are presented in Appendix Tables E*l to E*4, 
where eKt^^rnal factors ware included in the equations 
with the dependent variables being ES performance 

^c.'i-rc f// - ; -.y ^Y7-^ vc: ^jct: voly . Althoujh 

results are not er^tirely consistent^ several findings 
emetge , 



First, the percent of low^wage, low-*8klll workers 
in the labor force is an in^ortant factor in 
explaining variation among the states in individuals 
placed per man-year (as was noted by the Center for 
Applied Manpower He&earchV, placements per man**year 
percent of openings fille^f and percent of ^applicants 
placed. This may be interpreted to indicate that the, 
ES does a better job serving low-wage workers* or that 
low-wage workers and low-paying employers represent 
the primary market for ES services. AS a classifica- 
tion principle for grouping states, the item has the 
severe limitation that it is available only for 1970. 

The penetration rate is related primarily to two 
factors, the rate of growth in total employment and 
the rate of new hires in manufacturing. The rate 
of growth in eii[5)loyTOent tends also to be significantly 
related to placement productivity, while the rate of 
new hires in manufacturing' is related only to penetra- 
tion rate and to percent of openings filled. Percent 
of employment in each industry group tende to be 
related to ES performance, but in different ways' 
depending on which measure i? used and for ^ich year. 



Among the factors expected to have so|ne consistent 
relationship to eS performance were tlie unemployment 
rater the rate of change in the unemployment rate, 
and percent of U.S. employment, especially in a 
multi-variate analysis. The results obtained from 
the first*stage analysis did not confirm this \ 
expectation. 

In response to the growing national concern with 
rising unemployment and its. consequences for the 
operation and effectiveness of the Employment 
Service, research into the influence of external 
factors on the ES system was gradually changed from 
attempting to develop a typology or method of 
grouping states to analyzing the relationship 
between ES performance and unemployment. The 
immediate* specific goal was to develop recommenda- 
tions for the best and fairest method of reflecting 
unemployment in the funding allocation process. 
Beyond that* the analysis leads to some broader con- 
clusions which may be important inputs to the policy^ 
making process. 
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In this stage, 10 factors were used as escplanatory . 
variables in a multi-^variate analysis to explain 
\ variations aioong the states In indtvl4'a^ie placed , 
\ man-year in a Key moaaure/of B8 ;ftfficiency. 

J^,(ae'e Appendix Tables. i:*5 and Th4B; analysis - 

\'^^inclttded 3 meastirea relatliig to tmeinpldyRipsnt. The 
correlatiohs of the FYTS unesqployment rate and tho 
percent change in unemployr,ent with individuals 
placed per man-^year were not statistically significant. 
The third variable, claimants as a percent of new 
applicants and renewals, had a *.702 correlation (the 
highest of all variables} ^ indicating that ES 
productivity was lower in the states having higher 
percentages of claimants registering with the ES. 
(Productivity was positively correlated with growth 
in employment/ percent employed in contract ctmstruc* 
tion and in government/ and with percent low^vage 
workers.) 

The results of the multiple regression analysis 
yielded significant factors when all ten factors 
were entered into a step\;ise regression analysis. 
Of these factors, Ul claimants as a percent of new 
applicants and renewals was clearly the mo&t 
iiaportant/ as indicated by the fact that it had 
the largest Beta coefficient (21 percent larger 
than the next highest) • | It was alsb the first 
variable selected in thej analysis and, by. itself , 
explained 49 percent of the variance among the states in 
productivity* The regression coefficient (b) shows 
that a one-point increase in the claimant percentage 
is associated witti a .956-point decrease in pro- 
ductivity/ or a drop of nearly one individual placed 
per man-year. 

Finally/ analyses were conducted on the effects on 
lircductivity a*? measured in the FY76 BPF. Five factors 
were included; 

a. Percent of new applicants and renewals who were 
cls.iiaanl-s. The results indicate that those states 
with high percentages of claimants have lower* than-- 
avsreqe pcrforiranne. 

b, P.:xtB of growth eTap?.oyTrn*nt. A higher rate of 
growth is associated with higher productivity r 
alcncugh the relationship was not significant with 
PY7k produc-ivity. 
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c* Percent of workers in the state who are low-wage 
anfi low- skill* A higher percentage wa3 associated 
with higher productivity. 

d* Employnient in the stat^ as a percent of national 
employment* A higher percentage was luarginally 
associate^ with lower productivity* 

e. Unemployment in the state as a percent of total 
/ national unemployment. A higher percentage vas 
marginally associated with higher productivity, 
possibly because where. more people are unemployed, 
the average quality (skills, experience, education, 
etc.) of the unemployed individual is higher. 

3. Analysis of Factors at the Labor-Area Level 

Performance data were available for the first half of 
PY75 for 80 of the 150 major labor areas and for all 
states* Data was used in the analysis for the 80 labor 
areas and for 48 balance-o£-*state areas, which included 
all cities and towns outside the SO SMSA*s (Alaska was 
eliminated from the analysis due to extreme economic 
conditions; no data was available on external factors, 
for Puerto Ricoj the District of Columbia has no 
balance- of" state ; and no data were available ^or the 
small portion of Rhode Island outside the Providence 
SMSA*) Four performance measures were used in the 
analysis: individuals placed as a percent of new 
applicants and renewals (IP/AR) , and openings filled as 
a percent of openings received (OF/OR), both of which are 
EPF perforxnMce measures; also, individuals placed as 
a percent of the estimated number unemployed, and openings 
filled as a percent of honagricultural employment (OF/E) , 
both of which are composites of two EPF measures and 
indicate performance against potential* Productivity 
(individuals placed per man-year) could not be measured 
because man-year data were not available for the labor areas* 

The external factors included in the analysis, and the 

results for each were as follows (the regression results 

are shown in detail in Tables E-S to E-11) . : 

a* Rate of growth of employment* Although this factor 
was significant at the state level, it was not 
significant at the labor-^area level, perhaps due to 
correlation with industry variables* 

This measure of size was significantly negatively 
related to all performance measures, indicating that 
larger areas have lower performance* 
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Area unemployinent as a percent of th© national 
number of unemployed Individuals* Thle factor 
vas positively related to three of tfhe neaeuros, 
... the exception being CF/E* This Is also in part 
a neeaure of slsei however^ one cam speculate that 
the lerger the pool of unes^loyed Individuals, the 
higher the average skills, experience, ttAucatlon, 
etc« , of the unen^loyed individual, especially 
during a period of rising unerqployment. ^ 

d. ttieraployinent rate« In contrast to findings at the 
state level, the unemployment rate was significantly 
negatively related to two BPF measures of performance^ 
IP/AR and OF/OR, Indlcatln^r the nee4. for further * 
examination « 

d. Industry composition (percent of area employment In 
construction^ manufacturing and government). The 
results were quite mixed* Of the significant results^ 
percent of employment In contract construction was 
negatively related to OF/OR, but positively related 
to OF/e; the percent of employment in manufacturing 
was negatively related to IP/AR and OF/OR; and/the 
percent of employment In government was positively 
related to OF/E* The remaining industry groups were 
omitted from the aralysls because there was no structural 
hypothesis relating them to ES performance. It is 
quite possible that further aiialysis should also take 
into account the composition of growth In employment 
by industry. 

f. UI claimants as a percent of new applicants and, 
renewals* This factor was negatively related to 
all four Performance measures^ even though the 
analysis also took into account two measures 6f 
unemployment * 

g* Size class. Four specific size classes were included 
in the analysis: SMSA's over 3 million population, 
of v'hlch there are three? SMSA's 1 to 3 million^ of 
which there are 9; SMSA's under. 1 million, of which 
there were 68 in the analysis; and 48 balance-of- 
stdte areas* These were included In addition to 
tfie other size variables to test whether or not 
grouping of areas by size was better than using the 
continuous size variable. Because the sizes of 
classes are correlated with the other measures of 
^ r j[ rf* d^.^ Ik^ctiuso thn r^^^vr: regression procrarr 
was permited to select any three of the four, the 
actual numeric results are not useful* 
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What is iI^pol^tant and merits further analysis is 
that the sise classes tended to be statistically , 
significant, even vhen all other variables vere 
included*. This has implicaticms for the grouping 
o£ labor areas for the* purpose of setting Output 
standards that should be explored further In a 
future development program* 

Overall, the external factors appear to have explained 
less of the variance in ES performance at the labor* 
area level than in the analyses at the state level* 
One technical reason for this is that only 80 of the 
150 major labor areas were included as data points 
in the analysis, while the remaining 70 were lumped 
into their respective balance»of-state totals , due to 
lack of data* Some of the 80 areas included are 
smaller than some of those omitted* Data can be 
obtained directly from the states for areas that do 
not submit reports via ESARS to the national level* 
Tests using that data should explain more of the 
variation* It is also possible that a larger component 
of the variation at the labor area level is due to 
variation in local ES management, which could not be 
explained by external factors* Finally, no measures 
of labor force composition were included in the 

analysis, a conceptually significant omission* 

* 

In summary, the multiple regression results tend to be 
somewhat confusing and unstable, due primarily to inter- 
correlations among the various external factors* Further 
analysis is needed to examine the patterns of inter- 
correlation, to select items for retention, and to 
perform additional analyses* Given the results to date, 
it is not certain that a sufficiently small number of 
significant factors appear which explain variations in ES 
performance measures so as to permit development of 
meaningftll and comprehensible groups of states for purposes 
of setting performance goals and standards* 

Coii9>arison of regression results with BPF results at 
the state level 

Although the regression analysis has. not yet pinpointed 
specific factors for the purposes intended, the overall 
results can be used in analysis of^the impact of external 
factors on individual state performance* Using the 
results of the regression ^n^lysis of the relationship 
between individuals placed per man^year and the external 

l2ct- ^.^t : :i:,v3 beea grountid into four: cazcgori-js 

according to the amount of the residual difference 
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between placements per man-year<,predictea by the fomula 
and actual placements per man-year* These states having 
Actual performance much higher than preditted (approxi- 
mately one standard error higher) have beei^ classified in 
the "High" productivity group^ states between the expected 
and one standa^rd errcr above in the "Above Average' group ^ 
those below expected in the "Below Average" group, and 
those more than one standard error below in the "Low" 
group* ■ \ 

Similarly, those states having an FY76 BPF scor;e of 
29 percent or more (approximately one standard ^^^i^ti^'v 
above the mean have been classified in the "Higli" BPF 
group, those with a loss of 13 percent or more in the 
''Low** groups and the remainder divided into above and 
below average « 

The basic philosophy underlying the BPF and the relajbed 
performance stemdards development project is that states 
should be rewarded for overall performance which is 
better than expected, and vice versa* The taU^ulated 
results in Table II*6 with respect to placement produc- 
tivity show that the majority of the states received a 
"fair" result, comparing actual BPF grouping with the 
adjusted productivity grouping* However, the results 
show 7 states havinq a below-average BPF score had 
high actual productivity when compared with predicted, 
and 11 oth^r states had the converse situation* ^ 

E, Interpretation and Recommendations 

1* Registration of claimants 

The statistical analysis results presented above clearly 
indicate that the percentage of new applicants and 
renewals who are claimants is a major factor in explaining 
differences in ES performance among the states, although 
additional research is needed to' obtain more complete and 
precise results. This finding has major policy implica" 
tions because the claimant percentage is a function both 
of the rate of unemployment in a state and of state law 
and policy relating to application of the work test to 
new claimants* . 

Claimants v/ho are on temporary layoff and expecting 
recall have, little incentive to actively seek a new 
job* If state law or policy requires the ES to take 
work applications for such claimants, this might be 
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Table 11*6. ES productivity by State 



Actual Compared with 



Actual Productivity 
(BPF Score) 

High 


High 

VA,MS, 
IA,WA 


Above Average 
AZ 


Below Average 


Low 


Above Average 


MO 


WV, 
NB, 
CA, 


GA, 
ND, 
ID, 


KY, 
UT, 

OR 


AL, FL, SC, 
AR, LA, NM, 
OKy TX, CO, 
MT, WY 




Below Average 


NH 


MA, 


VT, 


MD 


ME, DE, NC, 
IN, MN, WI, 
KS, HI 


PA, TN, 

SD, NV 


Low 




CT, 


HI, 


NJ 


IL 


NY, MI, 
OH 



described as a workload item from which no end-product 
will result* Even if such claimants later leara that 
the layoff is permanent, and therefore begin to actively 
seek ? nevr job through the ES, it is likely that the 
original work application would require thorough review 
and revision* 

T?o illustrate the importance, take the case of New Jersey, 
which had an unemployment rate of 6*8 percent during 
1973, approximately the same as in 1972, and which required 
virtually all claimants to register* 61*34 percent of 
New Jersey's new applicants and renewals were claimants 
of whom only 5*59 percent were placed*' Data prepared by 
the state indicate that 44 percent of claimants were on 
temporary layoff* If these claimants had not been 
required to register, claimants new applications and 
renewals vjould have dropped by 169,000, and if the 
number of claimants placed did not change, then the 
placement rate for claimants would have increased to 
9*98 percent* Estimating other effects on the state is 
difficult* If one uses the conservative figure of 
15 minutes per new application or renewal and assumes 
an equal time expended on unproductive claimant referrals, 
then about 46 additional ES man-years would have been 
available for productive purposes and perhaps as many as 
3600 additional individuals could have been placed, 
ignoring any related nonplacement or overhead time* Of 
course such estimates ^are based on many questionable 
af^sumptions* 

When all external factors including the claimant percentage 
are included in a predictive equation, the actual per- 
formance of such low-performing states as Connecticut^ 
Rhcde Inland and New Jersey is in fact better than pre- 
dicted* On this basis, the performance of those three 
states is no worse than the performance of Arizona* 
flimila:rly^ a large group of states whose actual per- 
formance is above average are performing at less than 
expected rates. The difference among the states in 
claimant percentage accounts for many of the differences 
observed*^ (One test of a similar measure of the effects 
c£ welfare an^] food stamp applicants showed non- 
significant rdsults* ) 

At a time when unemployment is rising rapidly, ES 
administrators often beitoan the diversion of staff 
from ES to UI at the local level and the probable 
(3 4 i-p i' ^ "^'T'oti^rr fv<^^ to VZ fron th& n=^tior.r,l_ 
level all tJie way aown* The analysis shows that, even 
in FY7 4 when average annual employment grew nationally * 

\ 
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sxibstantial eS resources were diverted from serving 
active job seekers to taking unproductive applications 
for claimants as a result of state laws and policies. 
If similar laws and policies remain in effect under 
current econoraic conditions^ the true diversion of 
resources is substantially larger than it was last year 
and higher than one '^oul4 expect based on the simple 
diversion of ES positions. 

If MA were to adopt a radical policy on the issue # it 
should refuse to fund any application-staking or other 
service activity for claimants who do not voluntarily 
present themselves to the ES, since the goal is to 
minimize registration of job-attached claii(«mts. 
A less radical and more feasible policy would 
be to insist that registration requirements be liberalized 
in those states in. which the state ESC administrator has 
discretion, and to encourage other states to change laws 
that require registration of all claimants. The true 
policy objective of these changes is not to withhold 
services from claimants and not to encourage fraud but 
to conserve relatively scarce ES resources for the purpose 
of better serving those active job seekers who apply to 
the ES for job search assistance. 

Additional research needed 

At several points in the discussion of the effects of 
external factors on ES performance, mention was made 
of the limitations of the data and the research methods 
used. An important limitation not previously addressed 
is that the analytic model presented is a static n^del, 
in the sense that it does not attempt to account for 
intertemporal vernations in volatile economic conditions 
on the quarterly psrformange of the ES. Approaches to 
addressing this and other limitations are presented in 
the Methodology Guide s Volume 3 of this report. 

Using external economic factors to set ES output 
standards: a dilemma 

It was implied in preceding sections that^ following the 
philosophy applied in the BPP for previous years, a 
state whose overall performance was equal to the standard 
for the state should receive the same share of national 
ES resoxirces in the next year as it had in the previous 
year (this ignores, of course, "productivity increases", 
definitional changes, and other factors that affect the 
totirl c.: cz r:rc\.\r:^r- avr.ilrUc for allocation 
through the performance-based budgeting process.) 



It is clear from examining the research results^ that^ 
when all external economic and social # policy and law 
factors are taken into account, there would he quite 
substantial variations in expected performance among 
the states^ even if all states had performance equal to 
their standard* For ei^ample, ror FY74 at the state 
leveX# expected pyoductivity^^stimates ranged frotb 89 to 
206;^ yith 4 states having estimates under XOO and 4 
stated ;havin^ estimates over 1^0/ nearly t*iice. a^ high. 
At the 'labdr-area level, expected values for lp/0 range 
from less than 10 to over 15011 If Actual output standards 
are established for use in the funding allocation process, 
similar results can be expected, although the specific 
methods used will have a bearing on the resultant ranges 
of performance standards. 

In theory, the purpose of reflecting the external factors 
in setting output standards which will, be used in the 
resource allocation process is to adjust for factors 
beyond the control of ES management and to come up with 
standards against which ES management can be judged* 
states whose performance exceeds the standard are assumed 
to have good management and are to be rewarded accordingly, 
v;hile states whose performance falls below the standard 
are assumed to have poor management* 

The interpretation of the research results is that certain 
states having average management capability can reasonably 
be expected to have performance levels at least twice as 
high as certain other states also having average management 
capability* This leaves the policy-maker v;ith something 
Of a dilemma* On the one hand# it is desirable to reward 
cjood management, implying that the absolute; level of 
performance is rjOt being judged, only actual performance 
j:e3.e:tivo to a reasonable standard* This approach is 
advantageous, particularly v;hen in the past it has been 
the jL<xrr}o northern and eastern states who have suffered 
^rtost through EPF* If the standards are lower for such 
ijtates, it is less likely that they will suffer cuts 
in the future* 

On the other hanJ/ the ES exists to serve job seekers 
hrA employors woo request its cervices* Irrespective 
i,'^ the quality of management or the stability of the 
sa^v^cf: organization, it seems reasonable to allocate 
the resources to states where thef, greatest number of 
clients can be i;erved* It is often argued that resource 
raallGCal^ions through the BPF have in some sense penalized 
the peopl'^ living in tho states losing resources* The 
converse of this argurfient is that leaving resources in 
states v*^^r'" nc^'^-D 1 or yp^rctcc! rroc?;:Ttivity ic low 
(xrrespectivo of quality of mantigement;^) penalizes the 
residents of states where productivity is high* 

The policy-r;aker must address this dilemma, taking into 
account bctn the political and the program implications 
of different soltiLions* 
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Chapter III 



FIHDIKGS RELATIVE TO THE DEVELOPMENT 
OF INPUT STANDARDS 



Theory of Performance StamStards for the ES 

Perjibriaance standards axa "lapdels of , the placQntent proc^A9 which 
ca&;:belp dla9nose the caiia^ of poor perfoxd^nce ^en a6titfti 
placement operations are compared to thea. Thelf pvtpose Is 
to help improve the EmployiDent Service; particularly in local 
placement operations, ^e developinent of these standards Is 
not a simple matter and we recognized the difficulties of the 
task from the beginning of the project. In fact* doubts have 
been expressed that standards could be established without 
first answering long-range questions such as* ""Is the Employment 
Service serving employers or serving applicants?" or, ""Does 
the Employment Service aim to maximize placements or to reduce 
the unemployment rate?** When this stu(^ was started these 
questions already had a long history* perhaps they will have as 
long a future. It was clear to us# then, that we could 
not wait for them to be answered; the practical needs for an 
effective tool to carry out the purpose of Improving the place- 
ment process was too urgent. 

The ES faces a severe test in the current economic crisis. The 
stark days of the wagner Peyser Act itself are recalled when 
the levels of unemployment are considered * even more sobering 
are the projections for high unemployment as far ahead as the 
end of the decade.^ While th^ agency faces this challenge it must 
operate in a fiscal environment of extremely scare resources - 
there is little margin for inefficiency and waste. 

Art effective response to the coming (if not already current) 
demands for an effective and efficient Employment Service requires 
that adequate management tools be^put into the hands of state 
and local managers as rapidly as possible. 

In our view an Integrated Management system that combines the 
Balanced Placement Formula with diagnostic and prescriptive 
analysis (i.e.. Performance Standards) can be developed without 
waiting for the answers to long.range questions. Studies of the 
cost effectiveness of the placement process may take years; 
meanwhile there is an urgent need to make the current placement 
process as efficient as possible* at least until something better 
is developed* tested* and implemented. We therefore began our 
study by proposing a model for the placement process that 
depicted the current functional activities and the relationships 
between them. 



30 
45 



\ 



An overview of our mode-l' tfe shown 4n If tg; 1 beltw,' KQSources 
allocated to each functional activity- produce inputs to the 
placGracnt process. The inputs are assessed by comparing the 
actual performance levejls with standard levels to be determined 
throuah methods describ<id^'Jjt -this^-reipto,^^ effiotandy. Qf " • 

eAch. IunctiOi^ai activity, is^a^ses^ed by con^aring the' resources 
required for t|»e iBe3J?u3?i?d:f^«rf6rina4'ce* letfel^a 

model resources, .In tKi© .fijifojeb'tl^we hatre pi?ovicl©a''th6' following: 

• Scleption of. the i^AsurSS of perforitiantJe " * * ' ' 

• Development of a inetlibd to tneksujt^e the levels of pferformnce 
for each. JEunctloheJr . activity i_ . . ' . 

• Development of a inethod to" determine the resource - r^quirenients 
to ifteet those perf oarmance levels wheh the functional activities 
operate efficiently. . ' 
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Cur project was designed to set the stage for a larger survey 
that would establish the actual performance standards. Our 
objective was to develop methods which would be used in that 
survey. After developing the methods we tried them out in 
i^rveral locations to denonctrate tho^ir practicality and capa- 
bi^iity to develop the standards. In these pilot trials we 
de\*eloped a self-application procedure for conducting the surveys 
tJiat will significantly improve the scope of the next step by 
reducing .the need for a member of the study team at every site 
on every day of the survey. A Handbook for Analyzing Local ES 
Performance has been developed for collecting time-utilization 
d.^^.ta at the local level; for computing efficiency measures^ 
service percentages^ and key quality factor measures. In 
acSdition to serving as the method for collecting the data needed 
to establish and validate input standards^ the Handbook can be 
a^sed immediately for local office analysis. 

In the small survey we have conducted so far we have been able 
to prove the feasibility of collecting the data needed for 
establishing performance standards. Some trends and incSications 
were observed in even this small sample of locations; these are 
described in the next section of our report. These trends 
lead to recommendations for ES policy that are stated briefly 
before each discussion.. In many cases the ES is tending in the 
recommended direction anyway and the observations of our survey 
ccr^firm existing knowledge; we present our observations as 
sijpport for such policies and as illustrations of the insights 
!:he performance standards "methodology can provide. 

- ^ have been helped in designing this study by the consideration 
^r.d advice of a steering committee cons i ting of state and national 
^.ifice personnel. From time to time this committee has met to 
rc^ iiew the work of our team. On occasion they have recommended 
eliminating or adding components to our model of the placement 
" ■ excess. 



>r? believe that the remaining placement process components are 
vs'-^e^sary to any ES operation and therefore should be measured 
Ir. whc next step; a large survey to establish the actual 
::t.i^.dards. However^ statistical analysis of the data collected 
cliat 3ur%'ey may indicate differently^ and further changes in 
/ rtodel will be needed. In fact^ after performance standards 
I /e i>een established, such changes are still possible when 
:Cc^^.^3ilidation of the standards takes place. 
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B- Significant Survey Findi ngs 

1. File search is an effective means for making 
rof Grrals and it ir> of ton rriven ar caters- than- 
average emphasis .among offices that achieve 
high placement productivity. ■ 

i 

C i:: data indicate that file search is a cost^^ef f octive 
. referral method. We were able to compare th& placements 
made through file search referrals against those made 
through referral interviews in one office where the staff 
was divided between those serving walk-^in traffic and 
those doing only file search (normally placements cannot 
be distinguished in this way since fISARS does not record 
the source of the referral). For this office we found that 
the number of placements from both activities was as follows: 
85 due to referral interviews^; 35 placements due to file 
search call-*ins. Six people did fiXe search, 16 did referral 
interviewing. On this basis file .search was slightly more 
cost effective than referral interviewing (5.73 plcmt/pos 
vs. 5^3 plcmt/pos). , ^ 

Our data shows that high-performing offices. in this small 
survey generally (see Table following) devote a significant 
proportion of their resources to .file searc^i. If the 
sample was large enough to yield statistically significant 
findings f^om an analysis; of vai:iance we could determine 
rhe significance of file search in creating output perform- 
ance. Until the next step in establishing standards has. 
bsen ta>cen we cannot , say that fije search is. always valug±>le^ 
but it appears likely that it contributes to an efficient 
ES operation. ^ . --t 

3. Use of the self -application mode ^or completing 
registrations is a cost savings approach which^ 
r.any offices have successfully employed. 

We observed a local office that did not uSe the self- 
application technique and had seribus problems keeping up 
with the incoming traffic. ^One day duri^ng our Survey week^ 
they ran behind incoming trtlffic by o^yer^^two hours. Yet 
this office did not use the s^l^-applicatibn, method to 
recuce the time needed for ieach■applicartt■^"■ They believe ^ 
that applicants will mclke so many errors thai: the ±ime sav6d 
?.n coT^tpleting applications will be lost later in correcting 
applications. 

Ab a measure of the quality of ±he application^taking com- 
; . , ^ -.1" Li. L ,:^u.vi vj^jl / * N-i.o or: error :i iouii^I ii\ 

ai^plications. No great problems in error-correcting were 
reported nor were errors on applications taken by the self" 
application method estimated to be very high. Most offices 
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Fj:1.33 SEAnCtl/CALL-^IN (FC) 



unit: Call-in AttGiapts 



Unit Cost 



G.l 
10.4 
14.7 

8.2 



Perccnv, of 



10.1 
2.9 

13.3 
5.8 



Active Appl. PilG 



37.6 
7.5 
30.7 
10.2 



Plciiuits/ 

Time ladders 
•direct plcitbit 



ti : r c 



44 . 9 
43.0 
55.2 
35.6 



9.2 
9.1 



1.0 
2.8 



5.3 
20.3 



28.6 
6.7 



5.3 
8.3 



7.1 
3.4 



5C.0 
39.1 



45.8 
3.'i . 6 



6.0 
12.9 
5.8 

G,3 



5.6 
6.3 
1.1 
7.G 



58.1 
26.9 
9.1 
50.9 



20.^ 
18. 1 
21. 1 
24.8 



7.9 
V , 3 



0.6 
1.2 



1.8 
5.3 



.-.■S.l 
15.8 



10.7 



7.7 
9.3 



15.5 
26.0 



35.2 
28.1 



■ ■cc.'.int-. ^ 

■ t ,1". Positions 
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reported more than 90% of such applications had no errors. 
These facts hav6 led us to. conclude that where ad.'^.tional 
etaff time is needed for serving applicants (i.e./ walK*in 
trstffic is he-s^/i* and vjait times long) the self-application 
j|iode ;Can help. 

3. Job development can be^ over-used as veil as 

under-used. Use of the activity Is not tightly 
linked to placement^ performance when measured 
by the proportion *of referrals made through 
this means. ^ \ 

We found no consi. t-snt pattern of use of job development 
among the interviewers in the offices we surveyed; some 
did no job developmetitrwhile others placed a heavy emphasis 
upon it. (We found one interviewer whp relied almost exclu*^ 
sively upon this means for finding referralfS.) When used 
appropriately, job development is an effective method for 
placing applicants and,^ it generates support for the E& in 
the employer communitjl^ However, if it is overused and 
employers receive an excessive number of job development 
callS/ instead of generating support qu;ite the opposite may 
occur. 

An exclusive use of job^; development may . be symptomatic of 
an account interviewer style of operation which can be 
disruptive in a Job Bank. When this occurs we have an 
account interviewer style where it is not supposed to occur 
and job development is only the name given to referrals that 
are in fact actual job openings held exclusively by only one 
i n te.v vi ewe r . - , 

Ke observed such a situation in an office what was operating 
as part of a Job Banki The account interviewer style was 
not the official policy and there was no division of intern- 
viewers by occupations code or by any other breakdown; 
applicants were taken in turn by the next available inter- 
viovTer. In this case there was an interviewer who did not 
like the Job Banl: listing but preferred calling employers 
hecausBf 3£> he said^ he knew what they were looking for. 
In fact, certain employers only hired applicants who Were 
referred by this particular interviewer. 

Is this u3e of job development good for that office or bad? 
There is no simple answer to that question because there 
is no clear pattern or standard to tell us how much or how 
litcle of this component activity is effeptive. Job devel- 
opment iB a hiahlv indivicJ'nal proces?;, each interviewer 
pci^:^*.*..^ tx*i£ uctiviLy uiLierently based upon their iskills 
in relating to employ3rs, their knowledge of the local labor 
market and the type of applidants they normally see. Perform- 
ance standards aim at a level of assessment which might 



APPLICATION TAKING (AT) 



Uiiit: Applications Taken.* c .-^.^z^.,-! 
Service PerconH ;:^ M»w"^3plioa ttt3 a n^^ Renewals 



v",?.lcinnts/ 



•TiTfie lac^.dc-r; 

Unit 'Cost Percent Of ' " . -direct plcmnt 

I n Minutes Resources' Service Percent ! time only- 

11,6 11.6 . • ■ 37.5 44.9 

13.6 7.9 22.2 . • 43.0 
21.3 14.7 ' 34.0 - 55.2 

7.7 4.2 47.4 35.6 

15.7 14.5 46.9 ' 28.6 
16.6 13.9 26,7 6.7 

11.5 8.2 44.0' 45.8 

13.2 7.3 41.1 35.6 

15.3 11.2 15.3 20.2 
.19.3 11.4 28,1 18.1 

11.8 9.5 33.3 . 21.1 

18.3 10.0 30.7 

iOS 11.9 28.0 55.1 

•:r, .4 14.2 26.1 15.8 

31.4 4.4 61.6 35.2 
10.0 44.7 28.1 
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diagnose underuse or overuse of the activityj the individual 
performance of job development, can only be judged in the 
context of the entire office operation* 

In the Table below we have summarixed some of the data 
collected in this survey pertaining to job development. It 
seems clear that job development receives Quite different 
eruphasis among these offices. Although we did not perform 
correlation analysis on this table we can observe that high 
performance (in terms of placements per equivalent position 
of direct placement effort) is not tightly associated with 
emphasis upon job development. Four offices show job devel- 
opment placement exceeding 20% Qf total placements; these 
all also achieve placement productivity (column 4) above 
the average for the group in the survey. However^ several 
offices in the group achieve relatively high performance 
without much use of job development. Perhaps those offices 
with low performance and very low utilization of job devel- 
opment (underlined in this Table might consider increasing 
their emphasis upon this activity. 

4. Extra paperwork may occur when two separate counts 
of referrals, job orders^ or placements are main- 
tained . 

One objective of our project is to develop efficient and 
effective models of the employment placement process. These 
models will offer alternative approaches to the placement 
process in many offices * alternatives ^that are more efficient. 
These alternatives will achieve improved efficiency because 
they will eliminate redundant and unnecessary tasks. 

In our survey we attempted to identify such tasks, particu- 
larly in connection with computer-generated lists. These 
lists are often suspect, particularly in cases where a 
manual system has been replaced by a computer system? one 
often finds personnelniaintaining ,the old manual system until 
they are convinced that the computer-generated lists contain 
the same information* VThile this practice is deferisible 
during the implementation stage ^ it is not an efficient 
practice on a continual basis when two lists are separately 
compiled and cover identical transactions. They should be 
identical; however^ to make sure that they are ident ical 
a reconcilement process is often employed. The effort needed 
to compile twQ lists of the same thing is itself often redun*- 
dant. The work required to reconcile the two lists results 
in additional burdens. 

c;.: i/.i^ of ti.is '^it^ raaUauunt paper work vas observe;* 
by our team in one implementation of the Job Bank. The 
referrals to job openings were recorded on the back of the 
Job Orders directly from the referral forms (SOS's) and 
later these job orders were used to verify the referrals. 
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^ .^csource:5 
Job Dev. 



Placements/Equiv , 
Job Dev. Att fernptg Job Dev.Plcmnt Pos. of Direct 

^ . ' Plant Activity 

Total Traffic Total Plcmnts (Time Ladders 
(%) {%) Data) 



Minutes/ Job 
Dev, Attempts 



1.4 
1.4 
1.6 
0.9 




3.8 
11.4 

6 0 
6.0 


5.2 
6.9 

5.5 


44.9 
55.2 
43 Q 
35.6 


. ; 6.3 

■ -7.7 


0.8 




5.1 


16.6 


6.7 


■ • 10.5 


4.^ 




57.3 


35.2 


35.8 


■'■•■^ 6.0 


1.2 
2.7 




9.9' 
29.8 


28.4 
28.2 


35,6 
- 45.8 


= io,7 

' ■■■ ■ ■'5,9 


0.4 
2.1 

0o7 
1.2 




1.8 
5.8 
2.3 
5.7 


7.7 
6.5 
6.2 
10,4 


24.8 
21.4 
20.1 
23.9 




0.9 
0. 2 




2.1 
0.08 


2.1 
2.4 


55.1 
15.8 




0.8 
2.7 




6.3 
' 19,7 


11,8 
26.8 


28.1 . . 
35.2 





The Job Bank system produced a computer listing of these 
same job orders and the .referrals made to the openings on 
Uiem, Thia computer list was then compared to " the manually 
compiled list on the back of -'ea(^ ^rder and a retoncilement 
made between" the two- Discrepancies were traced;and xesolved- 
ThuSf two separately compiled Hats were maintained, The 
reconcilement effort required a Skilled and resourceful clerk 
who spent approximately three-quarters (3/4) of her time on 
this task- The computer-generated list served only to check 
the manually compiled list; it had no other bperational 
function in this office-" The same information was contained 
on both lists- Discrepancies when finally resolved were 
mino^- ► ■ > 

This office uses the MODS System which automatically checks 
the registration of applicants being referred- Occasionally 
two individuals are assigned the same SSN through error, 
and the ESARS system rejects one of the registrations - 
Correcting such rejections might pay off in keeping an up-to^ 
date ESARS file, but in this office, errors have been allowed' 
to accumulate in the file and the task of reconciling ''dupli- 
cate" SSN's is behind schedule- Duplicate SSN's are found when 
an individual is referred to a job opening. The Job Bank 
computefTlst is considered 'to be suspect and is not used 
for verification. 

We recommend that reconcilement occur when the duplicate SSN 
is first detected in the MODS system (at the time of regis- 
tration) instead of waiting until a referral to a job opening . 
occurs- By following that practice manual recording of 
referrals on the back of the job orders and use of those order 
forms for -verification would be unnecessary- The convenient 
curn^ around documents available in the Job Rank System could 
then be used for verification- The skillful clerk who now 
traces discrepancies could be used to keep all duplicate 
SSN's out of the ESARS files instead of only those detected 
upon referral to a job opening- She would be doing less 
redundant work- 

5. A non-Job Baiik urban area can be measured with 
our instruments - 

The criteria for selection of loo'atipns for our study was 
that offices surveyed would be willing to cooperate and 
would represent a variety of types of ES operations- San 
Francisco, the largest non-Job Bank area in the ES system, 
provided a test of our methodology in a city that did not 
use a Job Bank. We were able to administer our survey" in- 
striiTnentG in thrpc locil offico? and tvo rontral orclor tricing 
ojl^Is.^^- liic aata \vas comparable to other locations but we 
observed some shortcomings of the COT (Central Order Taking) 
system compared to Job Bank- 
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fThe Bay Area is interlaced with freeways and good roads 
resulting in long commuting distances from home to work. 
The highly urbanised SMfiA, extends from Marin County at 
the nort^orn cp.d of the Bay to San {?ateo at the southerh 
end. Bordering San Mateo, on the south is the San Jose 
SMSA, an area so similar that one does not notice any 
change while driving through the region. For workers who^ 
own an autoitobile, a job opportunity almost anywhere in 
the Bay Area is within commuting distance. 

To serve this large area the California Department of 
Hiiman Resources ha#. 25 local offices located throughout 
the San Francisco-Oakland SMSA. The SMSA has no automated 
Job 3ank but the manual methods used are similar to those 
used in automated Job Banks- Central Order Taking offices 
<COT) receive employer orders; teletypes, which are 
installed in every local office, are used to disseminate 
the job orders; they are transmitted on a **broadcast** basis 
to all the LO's in the COT's area as soon as the order is 
taken. At the receiving local office the orders are mounted 
on a board at the front of the office where applicants can 
scan them (address and employer name are not included in the ^ 
copy supplied for applicant review) . Referrals are controlled 
by calling the COT when an applicant is ready to be referred. 

In the Bay Area a number of Central Order Taking (COT) 
offices serve a segment of the LO's so that almost all the 
offices are qovered (there are some offices such as San Mateo 
not served by any COT) . The COT controls job orders and 
referrals in a manner similar to the Job Bank; however, there 
is this difference: the COT relies entirely upon manual 
techniques. The number of LO*s that can be handled manually 
is limited because a manual tally of referrals is maintained, 
on cop^GS of the job orders. 

Vie believe that the number of people needed in a Job Bank 
will be approxim^+tely the same as the present COT require- 
iaant2. The COT in Oakland^ which serves 10 LO*s required 
28 pecj.le and the other COT we surveyed, San Francisco, 
U53S 26 people and serves 7 LO*s. While the requirements 
for an areawide Job Bank cannot be closely estimated by 
cur team, we can get a rough idea of the personnel require* 
;:^*T:nts from the experience of other Job Banks; for example, 
x^Ym^ Dali<iS Job Bank serves 16 LO*s and requires 50 people 
:ivM the SrcH JOEje Job Bank has 33 people and serves 9 LO's. 

Although we believe there will be a small savings in 
p;;rsopnel throuah Job Bank, we think a more imoortant advan- 

applicants in the Day Area. The extended range of openings 
ij^ all local offices will more nearly meet the needs of the 
higHIy laobilo population in those communities. For those 
loccil offices such as San Mateo, presently excluded from the 
(COTl system, the change will result in a dramatic extension. 
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of the list of openings. The San^'Mateo office vould also 
benefit from the ancillary services - Such As Employer^ . 
Services associated with a central' 6rder-*taklng operation 
svch as Job B?nk, sircev urder/felie' -pressure of increased.* 
applicant io^d ahd -etaJE ^ftutspthat^ Off ice is. not presently 
making BS visits to th6 le*plby*r^ it 

6. A dGtail<^d study of the tim6 distribution system 
is needed to assess its^ accuracy as a management 
tool, particularly as a support for diagnostic 
and prescriptive analysis designed to improve local ' 
office performance. * ^ 

We surveyed local officiss to test 'a methodology that would 
answfer such quelstioris as: How rtuch work does it take to 
perform the placement process? Why do some eS operations 
accomplish more than other place^ although the staff 
resources are almost equal in both? 

It is essential to know the actual inputs to the placement 
process before any steps can be taken to improve prbductivity. 
The time distribution system might be used if it really told 
us what is going into the placement process; but more study 
is needed before we can confidently rely upon this data source. 
For example, measurements we took in one office showed 14.3 
equivalent positions devoted to the* placement process; how" 
ever^ the monthly time distribution reports on the same com- 
ponent activities showed 19.2 equivalent positions. This 
difference causes the placement process to appear less 
prodtictive in the time distribution system than we found 
through our. time ladder methodology. The examples below^ 
taken from two offices in the survey^ show typical discre'- 
pancies between the reports to the two measures of work* 

The contrast between time reported in our survey (time 
ladders) and cost accounting is illustrated in the following 
:abis cf Monthly Placement Productivity {placement trans- 
ections per equivalent position).^. Productivity is computed 
by dividing the ESARS total of monthly placement transaction^ 
jior each office by the number of equivalent positions : 
(positions are derived from time ladders and from cost 
accounting ac described in e^ich column heading) . If both 
recorded tiire T*qually/ column 1- and 2 would be identical.* 
In raost cases, cost accounting' shows lower productivity 
than the time ladder figures. We vrauld expect this since 
we found that non-placement time is frequently reported under 
^ost accounting as a 500 function' code direct placement 
activity. 



*There Is some error of measurement caused by the difference in measurement 
period used {time ladders is a weekly ^sample, cost accounting is monthly). 
' We checked some offices for this error where we had time distribution sheets 
for the period of our visit. Differences between time ladder and cost account* 
ing followed the differences exhibited by this Table; we conclude that the 
tible cannot be explained by the error of measurement. 
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Job Title 



Time 
Distribution * 



Time 
Ladders * 



Counselor 



5 - 512 
3 - 531 



Eir.p Intvw 



Unit Supv 



Counselor 



Supv 



Ver 



Aide Intv 



<^rder 
Taker 



2 
1 
1 
2 
2 

4 
4 



4 

4 



2 
5 
H 
H 

2 
3 
1 
1 
1 

1 
7 



- 511 

-514 (WIN) 
-531 (WIN) 

- 511 

- 531 

- 511 

- 531 



512 
531 



512 
553 
554 
561 

511 
531 
,561 
554 
610 

511 
531 



8 - 531 



2 - non-placement 
% - 511 

2h - 512 

3 - 531 

4 - WIN 

H - non-placement 
2 - 511 
111 - 531 



2Jj - bSARS revisions 

1-511 

3h - 531 

1 - personal 

h - 511 
IH - 512 
6 - 531 

H - 554 

4 - 610 

H - non-placement 

3 - 553 

eh - 531 

1 - 554 
- 511 



3 - 511 

2H - 531 

H - paperwork 

2 - personal 

5 - 531 

2 - paperwork 

1 - personal (lunch) 



^'{xi-jCQi hours - time code) 
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Table of ■ /' , ■ 

Monthly Placement Productivity ' ' ; 

tPlaoenants/Eguiv. Positions) ' i,'LV ' 

(D G © <D 

^ Plcmnts/ prcmnta/ PlomntA/ ' ' l^lcniitaj/': - 
; equiv.pos. eguiv.pos, equiv.jib*, e<iuiiifip(*fff% 

(orime laddersX /cost acctngV /br^sed inr^'d^^ 

-direct plciantj ( -500 code W cost V- f used In. ifsTS- 
time only- j \ ■ only-** y^acctng*j V ■• ■ WP - 



lA 


44.9 


■ • 25. 8 


24.8. 




IB 


•43.0 


28.3 


21.4 




IC 


55.2 


31. 0 


23.8 


22.2 






^ . U 


22 4' 




2A 


35.8 


21.4 


19.2 


14<>1 


2B 


6.7 


5.10 






3A 


45.8 


45.4 


36.3 




3B 




28.1 


28»0 


27 


4A 


19.2 


16.0 


11.4 • 






13,1 


18 9 


13.5 






21.1 


21. ^ 


12.1 


24,8 


40 


24. 8 


22. C 


22.3 ' 




?A 


55.1 


1G.91 


■ 44.5. 


22.6 


£b 


.-5.3 


16, 3 


13.8. 






55. 2 


19. 7 


17*3 


1S*5 




23.1 


20.2 


17.4 





*Includen all 205 timo plus central Job Bank or COT time 
allocated to th*2 local office on the basis of its fraction 
of total equiv* positions in the entire area served by 
the centralized operation. 

**Adjusted for holiday time- 
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believe that inanagesrs need sosm tool that accurately 
measures the v:crk done in each coraponent activity*. Tiiae 
distribution appears to conflict with our £indi|ig&. Of : 
work done* We believe that the time ladder rtetbodoiogy 
is more accurate because it ie tied to a measurable 
quantity for each activity period; this tendd- to make the 
staff member think about the activity time bein? reported* 
We also bclicA^e that tine distribution misses some of the 
iiQportant management issues because the 531 time is not 
broken down into finer categories* The 531 code accounts 
for approximately 50% of the resources directly devoted to 
placement and 6 of the 13 component activities cowjirising 
the placement process* 

6A* In assessing local offices that operate in a Job 
Bank environment certain functions otherwise 
performed in the office are done at the Job Bank 
Central and should be accounted for through anra 
allocation process. 

Job Banks nqrmally centralize some of the local office ES 
functions such as order taking and verification* The 
placement process component activities which we measure 
for Performance Standards occur # in the case of Job Banks, 
in two locations: the local office and the central office. 
An allocation scheme is required to account for each office's; 
share of the central office activities that are otherwise 
part of the placement process in the local office. The 
following is an approach we consider usable for this problem; 

a* In eajh local office, assign a code to each staff 
member, by primary function: managerial, professional, 
clerical, and supj^ort* 

b. Within each relevant geographic area allocate Job 
Bank (and other significant functions) staff to each local 
cffice based on LO share of professional staff in total area* 
^Could be allocated on professional, support^ and managerial 
if dstai.Ved data is available > 

In the metropciitan areas where Job Banks have been installed^ 
th(2 allocation scheme will include order taking and verifi- 
cation, but outside those areas these activities are generally 
not centralii'^.-d oven when there is a job Bank* Most non-- 
cnjtro local offices in a Job Bank system take their ovm or^t^rs 
^for example, Hattiesburg, Mississippi), do their own veri- 
fication and all their own referral control* The only shared 
activitv carr Led out in the Job Bank Central for those cases 

siupport afi gc;.(=^ral filing; it is an overhead function (code 
olO xn t;iu C^it, Accounting System)* 
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ttolumns? 3 and 4 of the Table of Monthly Placement Prodwtl- 
Vlty compare th<^ placement transactions produetlvlty a^^;, 
used'^in'^thd^PF for the state: with t:he. eqoiv^fhi. 
Ccnntoted^ fo* eat:>/ locffel ^of f ic^';ljt our' irorvey* ; ^ : 
measures were taken ^ from -the BPF^calculatlon iind tfa*rlctcarl ^ 
office «*eaetires wei:4 taken i from tti6 tlinr.dlsteKlbotijb«\t 
report 03 in the CA. system; Cbltunn 3 usee all Bft ti&ranta 
equivalent positions for the local office pluil a sharo^'Of 
the Job Bank or COT (Central Order Taking office): !Hhe):e % 
the office is served by sucH^a. centralized facility.: %he 
allocation ve used w&S'^ baeed"^ upon the fraction- of ^otal- ' 
equivalent positions located in that office compared to^ the 
entire area served (all positions were included tb^jCOin^te 
the allocation: ES and nbn-BS) , Other 8uggestl6n& have 
been advanced for making this, allocation! i,B. # fraction 
of total referrals made by each office^ or f ractiOH of total 
placer^ents made. Both suggestions allocate the central 
facility more closely to workload but they are much less 
stable than allocating total staff. We believe frore consid* 
eration is needed before deciding that some allocation 
method must be used if comparisons of local of f iOe^r- are, to 
have any meaning. An office which la supported toy aotivities 
in a centralized facility such as Job^Bank is obviously not 
comparible to one that receives no: support^ unlesb some 
account of resource utilization is made. 

However # this problem only exists where- the ES^ has a ^number 
of offices in an urban area. For. those situations perhaps 
the best approach is to study the labor area as;.a whol^. 
This suggestion was made at the start of our study by one 
of the participating agencies in their Response to the 
Steering Committee meeting held last June,. As bur^work 
proceeded the Validity of that suggestion wa&> clearly demon-^ 
etrated. We propose that the actual survey for establishing 
Perlorman-je Standards follow that method. 

The in^ithodolocfy would require data from each office to: 
provide the ecjuivalent ES. positions devoted to placj^ments 
in tJ\c entire area. These would' include all Qistxict iteupport 
posil-33ns, all Job Bank or other centralized positions, and 
thQ ES ecai5valent positions in the- local offlces^i tim&' 
laddei dati, re??-ecting the direct and indirect: pltoenreht 
^ctiv^ty Vv'onld be collected^ -the labor^ wWild:^i>e;^tareated 
as a unit. ^ . \ . - ■ 

1^ desired^ local offices within ,the labor area also can be 
a:ialyzed. Comparisons between local offices- in the saitte area 
vould rot rpc^\Hrf* allocation of tho contraliffed functions 
since tiiey ho\^U j c^cu^ve tjquai support from the central oper-- 
ation^ The allocation question arises when one of these local 
offices is compared to some office in another area or 1^ 
compared to a performance standard. 
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IiOcaX offices that ara not in the aame 4.abor areft can be 
compared (we show fiuch offices in the Table o£ Monthly 
Placement Productivity) ; however we sti^ongXy aug^esit that, 
ia not how Iter formance standards should^' be estabXldhed^'^ 
LocaToffices in urban centers should be i^eAtad? a» part of 
a labor area and the entire labor area should be studied. 

6B. Local office productivity can be expi^essed as 
Monthly Placement Transaction for Equivalent 
Position worked if the data used has; kieen adjusted 
for holiday time.. ;^ 

Our methodology measures local office performance during 
a one-week survey but expresses productivity as Monthly 
Placements per Equivalent Position**. TwQ basic assumptions 
are made in presenting- productivity in this forwt 

1 - Monthly ESARS placement ^trans- 

actions reflect the sam4 process 
as that observed during the survey 
week . ^ 

2 - The equivalent positions devoted 

to each activity have not changed 
during the month; i.e. r the 
survey was substantially repre- 
sentative of the entire month. 

Tiie survey week must be representative of normal local office 
operations to satisfy these assumptions. If unusual condi- 
tions occur, that are expected to change the performance of 
chfi office the survey should be rescheduled. An unusual 
condition of this type occurred in One flocation because our 
^tudy took place during election week- i The Employment » 
S^arvicc v/as open all day but the state gave each employee 
cne half day off* We had expected that all time off would 
be taken on Election Day; however, some individuals took 
the orje*half holiday on other^'days " of the^week. Thus, 
during tr.e week of Our survey one-half day was a holiday 
itthough the exact time taken varied. We would have pre^ 
:ferred to simply count the survey data on days when no state 
holiday applied. Unfortunately we could not do thisr there-* 
£ore "^e decided to adjust cur weekly survey data by reducing . 
the standard hours for the week from 40 hours to 36 hours. - 



cr<*es we d^d not compute service percentages for such local offices 

1 ^ i:r.iu:.s ^11 Lhe iocai offices iu Lho 

ire;. - {.rc surveyrjci. 

*^£r^i- sler^t PosUlons - Actii.il hours worked/available working hours for the 
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Every . fuil time individual had 36 hours, available ,fos work 
on ciny c.ccHtVj_ty in theft v^eek?/ the^xuloraj- ^we ad3u3ted ^.fp^ 
the 4 houxs of . holiday, by divi<3ing- all time by ^6,.ihpujrs 
to cT^t ectuive]ent oosition;** (in "normal" week-we WQulja u5^o 
40- hours) ; ■ /ihiS' ad>ustmentAfpi,3.ows fi;pm.the Uef init^iorxt'of 
equivalent pOsitionfif ^i*0'*^f the -niiinber ^of. people vho , co^ld 
do the reported work if they each put full time into the 

The Cost Accounting System should alsobe adjuste4 for 
holidays if comparable productivity is desired, We-^ made 
this adjustment to compute the figures in column 2 of the 
Monthly Placements Brpdugtiyity Tab^e* - Holiday -hourrs iarre 
deducted from standard , hour© ^and th^ result, is used., as the 
available hours for computing equivalent positions. ^ This 
adjustment removes the effects- of holidays to Satisfy- 
assumption 2 above? equivalent positions devoted to each 
activity are based on the worHing day^ in the month - no 
holidays. After this adjustment the survey week and the 
monthly equivalent positions , have a common base. 

We believe that the Cost Accounting System correctly states 
the equivalent positions pai^ foi: each activity but that it 
understates the equivalent positions worked. For example, 
November had 168 weekday hours including 12 holiday hours 
(Tl)anksgiving and Election Days) . ^ A full-'time person could 
riot possibly put more than 3^56 hours into any activity 
without goiug into overtime , hours. The two numbers (equi- 
valent positions paid and equivalent positions worked) .are 
close but they are .not equal ; r for November the drifferet^oe 
is 12/168 = 7*15%, Therefore, : the productivity figure- is. 
7,15% higher becpuse no ^djustinent for. holidays has been 
made to convert equivalent po/jitions paid- into equivalent 
positions worked. This ajctifact of the computation^ method 
should be eliminated befoi^e office or state cpmparisops 
are made. ^ ; * * - 
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C, R'^rcron^J? C^-^rts of COTt^pilc~2 Survey Data 

The charts and tables that follow are based on data 
collcctca in cul" 3tuc;y-v:-^k survey of 19 local offices 
in 6 states, and in some caSes^ on ESARS data* 
Following our visits to the first 13 offices, we 
manually tallied the tinie ladders and questionnaires* 
After the second 6 offices were surveyed^ on a self- 
application basis ^ we manually tallied the question-* 
naires^ but processed the time ladders via a computer 
program. Therefore^ the data in the following tables 
is displayed in similar formats, with differences 
ascribed to typing vs. computer printout. 

Tables are grouped as follows; 

1. Summaries of data for LO's visited; 

a. Study-Week Time Ladder Data Summary 

Placement/iTon-Placement Data 

b. Placements/Equivalent Positions 

2, LO Summary^ for each L0(19) visited: 



a* LO fiuHLmary^ Report 1 

3reakaow;i of LO activities, each represented in 
terms of total minutes- spent (in the study week), 
totai quantity processed, unit cost calculated, 
percent of total office time resource, and 
services percent, - 

LO Analysis of Non^Placement Time^ Report 2 

Jvroakdov?ii of LO Non-Placement (X) time, each 
category represented in terms of total minutes 
2pent. and percent of total time. 



Note: Table of Service Percent Formulas for Local 
0^.:icas r^nd for Labor areas. 
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Activity Summary, for e^ch ES(13) activity reviewed: 



a. Activity Summary: — , 

Analysis of activity £rom Ld.to' LO in terms of 
unit CQst calculated, percent of resource, service 
percent and placements/equivalent pcsition, 

b. Activity Quality Analysis: 

Analysis of quality f,aptor from L.O. to L.O. 
Question responses from staff, applicant, eniployeir, 
L.O- Manager are displayed.. 
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Summaries of data for LO*s visited: 
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TABLE - 'n.ACEMI^NTS/KQUIVALENT POSITIONS 



-USING TIMS LADDER DIRECT PLACEMENT TIME ONLY- 



ESARS , EQUIVALENT^ PLACE 

DATA PLACEMENTS POSITIONS- EtUIV 



10/74 485 10,9 



1 



-i 10/74 610 14.2 4j 

J.C 10/74 918 16,7 5b 

:d 12/74 253 7.1 35 



A 10/74 332 11.6 28. 6 

3 12/74 36 5.4 6.7 



3A 



10/74 
12/74 



995 
313 



3 X f 8 
8.8 



45.8 
3 5.6 



'4A 
4B 

JO 



11/7 4 
11/74 
11/74 
12/74 



582 
274 
173 
196 



28.8 
15.1 
8.2 
7.9 



^0*2 
18.1 
21.1 
24. S 



10/74 
12/74 



329 
41 



6.0 
2.6 



55 . 1 
15 .8 



10/74 
12/74 



1671 
304 



47.6 
1.0.8 



35 
28 



2 
1 



r 



TE 1; PLACEMENTS: ESARS TABLE 90/ LINE 90090 
FOR MONTH OF STUDY WEEK 

; 2: EQUIVALENT POSITIONS; SEE TABLE - 

TIME LADDER PLACEMENT MINUTES/MINUTES FOR 1 EQUIVALEN;. POSIl-it^N 
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